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§ I. Introduction 

The purpose of this dissertation is to derive a scale for the 
measurement of spelling ability and to show some of its uses 
and applications. Such a purpose relates itself closely to a 
general movement, which is now well under way, and which 
aims to place in our hands the means of stating with some- 
thing approaching the precision of objective measurement the 
amounts of each school ability possessed by an individual or 
a group. We received not long ago a scale for Handwriting 
(Thomdike, E. L., 1910) and still more recently a scale for 
English Composition (Hill^;as, Milo B., 1912). The former 
consists in the use of selected specimens of handwriting each 
of which has been evaluated; the latter consists of a similar 
series of English compositions. It will be noticed that some 
of the conditions of objective measurement are met. We meas- 
ure given specimens of handwriting by comparing them with 
actual samples of handwriting of known value. We determine 
the quality of English composition by a like comparison with 
samples of actual English writing of known value. 

It seems clear, therefore, that if we are to measure ability 
in spelling at all it will be by reference to an evaluated standard 
or sample of spelling. If we can arrange a series of words on 
a linear projection in such a way that the words from the low 
end to the high end are placed at equal intervals determined, 
by the difficulty of each word, and if we can determine a 
zero-point such that failure to spell the word fixed at that point 
under the required conditions indicates absence of spelling abil- 
ity, then we shall have constructed a scale by which we may 
measure the spelling ability of an individual, or by which we 
may through suitable tests determine the difficulty of any 
word in the language. Since the spelling of individuals may 
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thus be rated, tb^ SjSellihg of classes, of schools, and of school 
systems may.'lik^^i^e be;^ rated. . 

It ma^. ||l4*.said that we have always rated pupils in spelling; 

and th^1:V^ools and school systems have likewise been rated. 

Such'*ia**indeed the case. But there has always been a lack of 

^. '.precision in these ratings due to the inequality of the units em- 

•/•:*;jFl6yed. Dr. Rice (Rice, '97), for example, in testing the pupils 

in 4th to 8th grades in twenty-one school systems used a list 

of words containing among others: disappoint, necessary, 

changeable, better, because, picture. The method of rating 

pupils was the usual one of deducting from 100 per cent the 

same per cent for each word. That is, all words were taken as 

egual measures of spelling ability. A moment's attention to the 

^ six words mentioned will lead us to suspect that this is not a true 

assumption; and an actual test of a group of 5th-year children 

with these words shows that our suspicion is correct. In such 

a test mistakes were made as follows : 

* disappoint, 37 

necessary, 42 
changeable, 42 
better, 3 
because, i 
picture, o (Thomdike, '04, p. 8) 

To give these words equal weight in any test is to make 
inaccurate most of the conclusions based upon it. A pupil who 
spells all or nearly all of the list is a much better speller than 
the figures show; for he has probably spelled not only all the 
easy words but also many of the hard ones. On the other hand, 
a pupil who misses most of the words is a much poorer speller 
than his rating indicates because he has probably failed to spell 
' all the hard words as well as most of the easy ones. 

Nor is this list of Dr. Rice's at all unusual. Comman used 
the same list (Comman, '02). Both used a composition test 
where pupils were rated according to the per cent of their 
correctly spelled words among the total number of words in a 
written exercise. Comman also used a test in which school 



O 



Introduction 3 

children were required to write " as many words as they could " 
in 15 minutes. Of course in the composition test and in the 
15-minute test no two children wrote the same words. More- 
over, the words written by each child must have varied widely 
in difficulty. The result for the 15-minute test, according to 
Comman's best table, is as follows: 



School Year 


Median Percentage 


Average Varlvtion 


8th 


97.9 


.60 


7th 


96.2 


.50 


6th 


95.2 


.33 


5tha 


94.3 


.36 


5th& 


94.3 


.10 


4tha 


94.7 


.66 


4th& 


93.7 


.96 


3da 


93.5 


.23 


3d& 


93.0 


1.43 



One conclusion from this is that "pupils of the elementary 
school increase regularly from grade to grade in accuracy of 
spelling." This might almost be taken for granted. But in 
answer to the question, " How much does one grade surpass 
another?^' the figures afford no information. Obviously from 
all we know of the elementary school, the difference between 
eighth-g^ade ability and low third-g^ade ability in spelling is far 
greater than the figures 97.9 and 93 indicate. 

Similarly the Composition Tests of Rice and Comman are 
misleading when used to indicate spelling ability. According to 
the series of Composition Tests of the latter, 8th-year children 
on the average spelled 99.5 per cent of their words correctly, 
and children of the first half of the 3d year spelled 93.2 per cent 
correctly. The author draws conclusions from his figures as 
to the progress of each g^ade for the school year, as to the 
progress of the school and as to the effect of the suspension 
of instructioir Nin spelling. Since in the series of eight tests 
the children wrote various kinds of lessons — Geography, History, 
Science, Language, Composition — each with its own peculiar 
words, and since each pupil used his own individual vocabulary, 
we cannot escape the conviction that while these figures may 
be suggestive of progress, or of the effect of change in method, 
or of grade differences, they are nothing more than suggestive. 



4 Spelling Ability — Its Measurement and Distribution 

They leave unanswered the questions, — ^How much progress? 
How large an effect? How great a difference? As we grow 
more and more accustomed to quantitative thinking in our edu- 
cational work, we feel that these are precisely the questions that 
we ought in some way to be able to answer. 

These studies of spelling made by Comman and Rice remain 
the most important statistical treatment of the subject. That 
they have not great value it would be presumptuous even to 
imply. Their results are in a general sense true. To a certain 
extent their lists, even though made up of words of various 
and undetermined difficulty, may be used, especially for com- 
parative purposes, as a total measuring device. They do, how- 
ever, undoubtedly suffer through lack of precision, while their 
statements of amounts of difference are in general misleading. 

The same thing may be said of later investigations. For 
example, Wallin's tables and his conclusions from them as to 
the transfer of spelling efficiency and its relation to age, grade, 
and sex are subject to the same limitations (Wallin, 'ii). Pear- 
son's " Experimental Studies in the Teaching of Spelling " 
(Pearson, '12), however, shows a recognition of the difficulty, 
although it offers no remedy. In his treatment of the relative 
values of the " together-method " and the " separate-method " 
of teaching homonyms this author says : " Owing to the in- 
equality of the imits of measurements, it is impossible to deter- 
mine accurately from Table IV whether the together-method 
is superior to the separate-method. One cannot decide, for 
example, positively whether an improvement from 3.78 errors 
(median of a class) to 2.86 errors is greater or less than an 
improvement from 5.6 errors to 3.3 errors." If, however, the 
words used could have been evaluated through an independent 
test by reference to a scientifically constructed scale, the " in- 
equality of the units of measurement " would have disappeared. 
The further treatment of the foreshortening of the opportunity 
for improvement due to high initial performance is quite another 
matter. 

It will be clearly seen from the forgoing that in practically 

all work which has attempted to present the spelling situation 

A statistically it is assumed as fundamental that one error equals 
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another and that to spell one word is the same as to spell/ 
another word. 

It will therefore be profitable to seek in this field as others 
have sought in other fields to devise an instrument which will 
more accurately measure that of which we are so often called 
upon to give a quantitative statement. 

§ 2. Limitations 

The study here attempted is confined to the elementary school 
entirely. It covers the grades from the third to the eighth, both 
inclusive. The schools tested are all located in or near New 
York City. The cosmopolitan character of the population of 
the metropolitan area makes it extremely unlikely that results 
of a materially different character would have been obtained 
by testing schools in various sections of the country. 

It is believed that these schools are fairly typical within the 
limits of the area chosen. School I is a private school of high 
class whose pupils are mostly American bom and from good 
homes. All the other schools are public schools. School II 
is in a German section of rather low class. School III is in a 
better neighborhood, foreigners predominating. School IV is 
in an Italian section. It has long had the benefit of high-class 
supervision and organization. School V is again predominantly 
American. It is located outside of the city system. School VI 
is in a good residential section of the city. School VII is a 
large school, most of whose pupils are of foreign parentage. 
Territorially, two schools are in Manhattan, one in the Bronx, 
one in Brookl)m, and two in Queens, while one is outside of the 
city entirely. 

In all 8,791 pupils were tested. It is thought that this is a 
sufficient number for practical purposes. In fact it was found 
that the returns from each additional school after the first three 
or four made almost no change in the results. It is probable 
that greatly increasing the number of pupils tested would have 
afforded little compensation for the additional labor. It has 
seemed wiser to limit the number to a moderate one and to 
spend considerable effort in making the statistical analysis as 
complete as possible. 
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§ 3. The Original List 

The preliminary testing was made with a list of 270 words. 
It will be called "The Original List." It was itself selected 
from a much larger list of graded words used by the author 
of this dissertation in his own school, the same having been 
secured by taking from five of the popular Spelling Books now 
in use a vocabulary of 5,000 words agreed upon by two or more 
of tiie books. The principles of selection for these 270 words 
were: (i) that all of them should be sufficiently common to be 
in the speaking vocabulary of third-grade children; and (2) that 
the spelling difficulty of many of them should be great enough 
to test the ability of eighth-grade children. As a matter of fact, 
the selection did not consist of 270 words at first. The list grew 
to that number only after the chosen words were put into sen- 
tences. The necessary helping wordsi then swelled the total to 
the number given. 

The sentences were dictated during the fall term of 1910 to 
schools I and II. They were given to grades 3 to 8 in School 
II, and to grades 4 to 7 in School I. Their dictation consumed 
several periods for every class. The following are the sentences : 

There were forty birds on the bridge. Do not go until I come. 
On Wednesday an umbrella was found. Whose pencil is thisf 
My uncle gave me a banana. The butcher gave the hungry dog 
a piece of meat. My answer is ninety. For a nickel I bought 
an orange, a peach, and a pear. A dollar is not too much money 
for so beautiful a picture. Learn to do right because it is right. 
The chicken ran across the road. The janitor sweeps every Tues- 
day afternoon. It is wrong to steal even a penny. It would be 
easy to watch for your cousin from the parlor window. It is 
the hour for recess. Smoke was coming out of their chimney. 
One summer evening my neighbor came into my kitchen. I did 
not know he was coming that night. To whom does this pair of 
scissors belong? I am almost sure they belong to the tailor. 
The doctor thought he ought to go ai once. His bicycle was 
against the fence. But a carriage was stopping in front of his 
oMce. His friend was already beginning to speak to him. He 
said the soldier should have medicine this minute. Pshaw, there 
was neither a monkey nor an elephant at the circus. Get some 
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coffee, sugar, and soap at the grocery store. The soldier dropped 
his sword and pistol. Jack had a whistle and nineteen nails in 
his pocket. The ^r^/^y /airy had a jawry tongue. One day in 
February people saw a j/^t^A pofj through the at/^iu«e. Shoes 
are made of leather and a /tV/te iron. A w^^fc from to-day there 
«;i// be a dance. Cut up a tomato and an onian together. In my 
garden I j/ia// ratfe cabbage instead of 2?ee/^,r. The saucer was 
round like a circ/^. Afafc^ no noise; do not whisper or laugh. 
Nobody should be without a handkerchief. A straight line has 
length only. We shall believe the /rw/A. We have another piano 
at our school. Is it /rM^ that there was grease on the towel f 
This animal has a /ar^^ mouth. It is not o/^^ ro/d enough for 
the ac^on to freeze. Guess what made me sneeze. Choose which 
one of the pigeons you like. Touch the button with your thumb. 
The American Indian had ram and tobacco. I have written the 
wAa/e alphabet. I w^ar a number thirteen collar. If the m^n 
quarrel, telephone me or j^nd a telegram. Our arithmetic lesson 
is in addition. We a/^a subtract. A handful of com was a// I 
had for supper. What is the /^i/fe of the story f Did you A^or 
the thunder last night? I am ^ytn^ up my shoe. A &artn of 
tw^^r ja/ on the ^a&/^. That sentence has twelve words in it. 

Those who dictated the sentences were directed to read them 
in whole or in part as many times as seemed necessary to secure 
their complete comprehension. Pupils were therefore not re- 
quired to retain in mind a long series of words. 

In rating the papers only the words printed in italics were 
considered. If a word occurred twice it was regarded only the 
first time it appeared. Omitted and illegible words were classed 
as wrong. All the papers here as well as elsewhere throughout 
this study were rated by the same person. They were rated 
from two points of view: (i) as to the number of times each 
word was correctly spelled, and (2) as to the per cent of the 
entire number of words each pupil spelled correctly. The former 
point of view is the only one to which attention is now directed. 

Table I is a sampling from the entire 270 words as given to 
schools I and II. At School I the grammar-school course is 
completed in seven years. It therefore has no 8th grade. As 
stated above, the test was not given to the 3d grade in this school. 
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§ 4. 71ir Sd£cted List 

On dbe tosis of tbe results for tbe Orignal List, a gnx^ of 
100 words was chosen. It is here called the ^ Sdected lisL^ 
Bi Tat4e I are shown 15 words from the Original List The 
word ^ across ** is tyfical of the words taken for the G c leitrd 
List Since 17 per cent of the jd-grade cfaildTen q>dlcd it €X>r- 
rtedy, it was not so diflimit in that grade as to offer no test 
oi MSty, It showed a steady increase th r ougho ut the f oOowiq^ 
ip^ftdes but did not reach so high a figure in the h^;hest grades 
as to prcrent its being a test of abilitj there. "Ahnost'' and 
^ button '^ were diosen for the same reason. ^Addition " was 
not taken because it was too hard for jd-graders. Only 2 per 
cent wrote it correctly. So small a number as two in a hundred 
mif^ get it r^;fat by chance. Practically, therefcKie, the word 
is a zero word for Ae 3d grade; and sudi a word does not test 
ability. There may be— and in a given grade there certainly 
would be — ^wide differences in spdHi^ ability, but sudi a word 
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will not show them. "Alphabet" was rejected because though 
high in the 3d grade it was very low in the 4th, suggesting that 
in School II it was a word that the children had recently studied. 
"Arithmetic" was not taken because from the 6th grade on it 
oflfered practically no difficulty. As in the case of a word rated 
at zero or nearly zero, so in the case of a word rated at 100 
or nearly 100, there is no test. Good spellers and poor spellers 
so far as the particular word is concerned behave exactly alike. 
" Bridge " was not taken for the same reason. " Choose " was 
too hard in the 3d grade. "Day" was too easy everywhere. 
In fact " day " is a type of word such that we may almost be 
warranted in saying that one who cannot spell it has no spelling 
ability. " Guess " was taken because although it is very seldom 
spelled correctly in the 3d grade, its form is so peculiar that the 
few who did write it correctly probably knew how to spell it, 
i.e., did not get it right by chance. " Handful " is a type of 
word taken because although it shows no regular increase from 
grade to grade it offers a real test for every grade. The later 
results in other schools, however, showed that its irr^^larity 
is not accidental in schools I and II but is a peculiarity of the 
word itself. " Pshaw " is a familiar word to the ear, but not 
to the eye. Very few get it right in any grade. It was rejected. 
" Tomato " is curious. On the whole neither school does any 
better with it in the highest than in the lowest grades. It was 
not taken. This word and the word " handful " strongly suggest 
the need of a greater number of pupils to test. The word " too " 
is a word which is misspelled with astonishing frequency. The 
difficulty is not so much one of spelling as of confusion with the 
other two words which have the same pronunciation. It was 
not used in the Selected List but was later included in a small 
supplementary list just to "try it out." "Whose" was taken 
although it shows a dip in the 5th and 6th grades. Pupils in 
these grades have learned the use of the apostrophe and their 
" little knowledge " proves a " dangerous thing " which the pupils 
of the earlier grades avoid. 

These words— each more or less typical in its way — show how 
from the Original List of 270 a better Selected List of 100 was 
chosen. Again the words were put into sentences, as follows : 
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Whose answer is ninety f If the janitor sweeps, he will raise 
a dust. You ought not to steal even a penny. Wait untU the 
hour for recess to touch the button. Smoke was coming out of 
^Aeir chimney. Every afternoon the butcher gave the hungry 
dog a ^iVc^ of meat. One evening a carriage was stopping in 
/r(7n^ of my kitchen. I w^ar a number thirteen collar. Guess 
what made me sneeze. Send me a pair of leather shoes. I do 
not *w(?ze;, bu* I am almost sure they are mine. My tinc/e bought 
my cousin a pretty watch for /or/y dollars. The soldier dropped 
his sword. Jack had a whistle and o/^o twelve nails. The oc^on 
do^j not a//^n freeze. You should speak to people whom you 
meet. It takes on/y a minute to ^Of^ through the gate and across 
the r(?a(i. Did you ever Aeor a /airy laugh? The American 
Indian had a saucer without a cup. Neither a p^ar n(7r a peach 
was at the grocery store to-day. Cut up a tt;A(7/^ onion with a 
handful of beans. My j^ano /^won was eojy. The animal ran 
tn^o the road and straight against a tree. Give me another sen- 
tence which has the word " rtrf^ " in it. I believe true friends 
like to be together instead of apart. 

These sentences were dictated at schools III, IV, and V in 
the spring term of 1911. They were later (fall of 1912) dictated 
at schools VI and VII. 

The following instructions were given to the examiners : 

Please read these instructions through before beginning to dic- 
tate the sentences. 

I. See that each sheet is headed with (a) the pupil's name, 
(b) the date, (c) the grade, (d) the name of the school. 

II. Give all the sentences during one session, i.e., either in 
the morning or the afternoon of the same day. 

III. In classes below the fifth year dictate in two periods, 
separated by at least half an hour, or by a recess period. 

IV. Each sentence may be dictated, either in whole or in part, 
as many times as may seem necessary to secure its complete 
understanding. This exercise is purely a test in spelling. It is 
not intended that pupils should be subjected to the added diffi- 
culty of an effort to recall the words dictated. 

V. Offer no explanation of words or sentences. If the mean- 
ing is not clear, repeat the sentence as a whole or in part. 

VI. Do not ask the children to underline words nor otherwise 
call their attention to the significant words of the sentences. 
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VII. After the children have written the sentences, read them 
again and allow pupils to insert words or make other corrections. 

VIII. Collect the papers. 

Subsequently at the same schools (III, IV, and V) was given 
a supplementary list of i8 words, again selected from the 
Original List (270 words). With the same directions to the 
examiners, these words were put into sentences as follows : 

Telephone me on Tuesday if the tobacco comes. The tailor 
sent a saucy telegram. Already the circus was beginning. 
Pigeons seem too beautiful to quarrel. I am trying to choose a 
towel. The chicken was fried in grease. 

Each of these 118 words was scored in each grade and for 
each school separately. Table II illustrates for a few of the 
words the manner in which this was done. The figures indicate 
per cent correct. 3a means third grade, first half ; ^b third grade, 
second half, etc. Ill, IV, and V refer to different schools. 

It will be seen at once that there is no steady progression for 
each word as we pass from the lowest to the highest grades. In 
fact for this and for other reasons it was found best to deal 
with grades by years rather than by half-years. It also seemed 
advisable to choose a few of these words and to make them 
the basis of study. 

§ 5. The Preferred Lists 

From the data now in hand it was possible to select a few 
words which showed reasonably regular increase from gjade to 
grade in the per cent of times they were spelled correctly. Two 
lists were made up, each containing twenty-five words. The 
first list is superior to the second in the testing power of the 
words in all grades and in the permanence of their relative diffi- 
culty throughout the grades. That is, to a somewhat greater 
extent than in the case of the second list, the words of the first 
list are found to be easy enough for low grades and hard enough 
for high grades. Also, a word occupying a certain serial posi- 
tion (say the 4th in point of difficulty for the third grade) tends 
more strongly in the first than in the second list to occupy the 
same position in all other grades. That both lists, however, are 
reasonably satisfactory in these particulars will be abtmdantly 
shown. 
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TABLE II 
Figures Indicate Per Cent Correct 



Grade 


3a 


36 


4a 


46 


5a 


5b 


6a 


66 


7a 


76 


8a 


86 






against 

III 


20 
5 


8 



12 
10 
11 

22 
37 
33 

56 

15 




8 


7 

10 




3 



60 

19 



77 
3 
4 

16 
39 
28 

40 
61 
38 

61 
25 
11 

2 

6 

45 

4 

10 
16 


45 
45 


54 
26 
10 

37 
17 
24 

44 
38 
45 

63 
68 
62 

65 
54 
28 

13 

74 
9 

17 
16 
31 

15 

34 




43 
29 
15 

54 
36 
14 

72 
58 
38 

75 
71 
60 

46 
19 
14 

31 
50 
32 

52 
36 
19 

58 
27 
85 


60 
70 
30 

53 
32 
28 

78 
72 
55 

73 

78 
60 

60 
59 
36 

24 
63 
61 

45 

49 
21 

64 
54 
18 


62 
61 
52 

44 
22 
55 

83 
82 
68 

70 
81 
84 

65 
49 
52 

61 
22 
50 

40 
51 
52 

46 
40 
26 


60 
92 
54 

35 
50 
76 

91 
97 

84 

88 
85 
80 

70 
61 
64 

66 
57 
82 

33 
73 
66 

14 
10 
36 


91 
78 
74 

57 
52 
50 

95 
93 
74 

82 
93 
79 

86 
60 
61 

49 
67 
64 

73 
60 
45 

60 
11 
41 


73 
95 
63 

73 
62 
77 

98 
97 
68 

93 
97 
79 

71 
87 
62 

83 
81 
50 

78 
83 
66 

24 
33 
18 


93 
94 
81 

93 

78 
71 

97 
96 
90 

97 
98 
88 

80 
82 
71 

64 

74 
89 

83 
72 
79 

14 
33 
26 


97 

100 

88 

73 
83 
84 

100 

100 

86 

97 

98 

100 

97 
83 
79 

96 
84 
80 

80 
78 
81 

65 
53 
51 


95 


IV 


97 


V 


89 


believe 
III 


85 


IV 


78 


V 


72 


cousin 
III 


100 


IV 


100 


V 


91 


know 

III 


100 


IV 


100 


V 


96 


ninety 
III. 


80 


rv 


86 


V 


74 


pi»»ns 


86 


rv 


95 


V 


84 


saucer 

III 


75 


IV 


78 


V 


78 


too 

III 


32 


IV 


45 


V 


39 







The first list will be called the " First Preferred List." It 



contains the 

1. even 

2. lesson 
3- only 

4. smoke 

5. front 

6. sure 

7. pear 

8. bought 

9. another 



following words: 

10. forty 

11. pretty 

12. wear 

13. button 

14. minute 

15. cousin 

16. nails 

17. janitor 



18. saucer 

19. stopping 

20. sword 

21. freeze 

22. touch 

23. whistle 

24. carriage 

25. nor 
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The second list, called the " Second Preferred List," is as 



follows : 

1. already 

2. beginningX 

3. chicken 

4. choose 

5. circus 

6. grease 

7. pigeonsx 

8. quarrel 

9. saucy 



10. tailor 

11. tel^ram 

12. telephone 

13. tobacco 

14. too 

15. towel 

16. Tuesday 

17. tying 

\ 



18. whole 

19. against 

20. answer 

21. butcher 

22. guess 

23. instead 

24. raise 

25. beautiful 



Table III gives for each word of the First Preferred List 
and for each grade the number of times the word was written, 
the number of times it was spelled correctly, and the per cent 
correct. Schools I, II, III, IV, and V are included. (Omitted 
words are considered as " written " and as wrong.) Table IV 
gives the same facts for the Second Preferred List. 

It will be seen from taUes III and IV that for any given 
word the per cent correct in one grade is higher than it is in 
any lower gjade. This is, of course, to be expected. But it 
is not sufficient In order that this list should be of greatest 
value it should be so constituted that these increases in 'per- 
ccnts-correct ' so keep pace with the increase from grade to 
grade of general spelling ability that a word tends in all grades 
to maintain the same difficulty relative to all other words in the 
list to which it belongs. A word which is 20th in point of diffi- 
culty for the 3d grade ought to deviate as little as possible from 
the same rank in the other grades. The experience gained in 
making this investigation leads us to think that most words 
do not meet this condition even approximately. The span be- 
tween the 3d and the 8th grades is very wide. Accordingly a 
very large class of words is impossible for the earlier, yet easy 
for the later, grades. Still others are really difficult in the lower 
grades but of almost no difficulty in the upper grades. From 
our own Original List "coffee" and "people" are hard for 
3d- and 4th-graders, but are almost always spelled correctly 
above the 6th grade. A third group of words breaks down in 
the middle. They appear to be easy in the lowest and highest 
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and hardest in the middle grades. " Whose " is a type of such 
a word. It presents no great difficulty until children learn the 
use of the apostrophe. Then they write " who's." Later they 
partly recover from this practice. There are quantities of words 
which show this dip in the middle grades. One homonym is 
often easy until the other has been consciously related to it 
Analogies falsely assumed play a harmful role. The rapid en- 
riching of the vocabulary as new subjects and new phases of 
old subjects are taken up in the middle grades probably induces 
some confusion. To just what extent this is true we do not 
know but we are sure that it is true to a significant degree. 

Finally, we have the large class of words which — when a 
sufficient number of children are tested — do show an increase 
in correctness from grade to grade, but which do not advance 
in anything like a constant ratio to the advance from grade to 
grade in spelling ability. Even among the words chosen as most 
favorable this discrepancy may be seen. The word " sure " 
(Table III) is 47 per cent correct in the 3d grade. This gives 
it a rank of 6th among the 25 words of the First Preferred List 
for that grade. In the 4th grade it advances to 55 per cent 
correct, but this advance is not sufficient to maintain its position. 
It falls to a rank where it is tied with " whistle" for nth and 
I2th place — i.e., its rank is 11.5. In the 5th, 6th, 7th, and 8th 
grades its rank remains fairly constant with the 4th-grade rank. 
It is 10.5, 14.5, 10.5, and 12. 

If this sort of irregularity is found in a word chosen as among 
the most regular, it will easily be seen how much greater would 
be the irr^^larity of words which were rejected. 

§ 6. Examination of the First Preferred List 

To further establish the value of the lists, we may investigate 
the behavior of the words as between grades in each school 
and in all schools combined. We shall b^^ with the First 
Preferred List. This list was chosen in the first instance from 
the returns of School I. It was taken to be the 25 words of 
closest correlation between the grades of that school. It was 
then referred to the other schools and the correlations were 
worked out for them. 
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The method used was that suggested by Spearman in his 
article: "'Foot-rule' for Measuring Correlation*' (Spearman, 
'06). This method is explained and criticised by Brown in 
"The Essentials of Mental Measurement," pp. 71-76 (Brown, 
'11), and in a more elementary way by Whipple in his " Man- 
ual," pp. 34 and 35. (Whipple, '10.) 

The formula is 

R = i 

i/6(N« — I) 
where S(^) denotes the sum of the "gains" in rank (sum of 
positive differences) of the second series on the first, and 1/6 
(iV* — i) is the value of the stun of such gains which may be 
expected by chance. These J?-values were then expressed as 
r-values (Pearson Coefficients of Correlation) by means of a 
table of equivalents. This table (Whipple, '10, p. 36), has been 

worked out from Spearman's conversion formula r = sin (—/?). 

2 

The method is illustrated for the 4th and 5th grades of School 
I in Table V. 

^(9) 

By the formula, -R == i , R = .72. This is 

1/6 (N^ — I) 

equivalent to an r-value of .90. The correlation is therefore 
very satisfactory. Its Probable Error is .026, which is so small 
in relation to the obtained correlation, that the latter has a very 
high degree of reliability. 

The correlation of each grade with every other grade for 
School I was as follows: 



Correlation of 4th grade with sth grade. 
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90 
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92 

93 
88 

90 

(P. E. = .026) 
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TABLE VI 
r-VALUES Between Gradbs of School I as Found bt Three Methods 



Pairs of Grades 


Foot-rule 


Product- 
moment 


Unlike 
signs 


Average 


4th with 6th 


.90 

.88 
.88 
.92 
.93 
.88 


.92 
.76 
.73 
.78 
.79 
.91 


.99 
.97 
.81 
.99 
.88 
.93 


.94 


4th " 6th 


.87 


4th ** 7th 


.81 


6th " 6th 


.90 


6th « 7th 


.87 


6th ** 7th 


.91 






Averages 


.90 


.82 


.93 


.88 







method. It has therefore seemed justifiable in future computa- 
tions of this sort to save the threefold labor and to rely upon 
this method. 

It is to be expected that since the list of words was in the main 
selected from the results in School I, the correlation will prove 
to be higher in that school than in any other. Such is indeed 
the case as will be seen by an inspection of Table VII. It will 
be remembered that School I has no 8th grade and that the 
3d grade in that school was not tested. 

We find that the correlations in School II are considerably 
lower than in schools III, IV, and V, even showing an apparent 
inverse relation in one instance. Yet the average of the coeffi- 
cients for School II is 42, the P.E. of which is less than .11. 
A correlation is entitled to scientific consideration if it is more 
than twice as large as its probable error. This one is nearly 
four times its probable error, and may therefore be regarded 
as satisfactory. Still more so are the relations between grades 
in the other schools ; while, for all schools combined, the coeffi- 
cients of grade-to-grade correlation range from .47 to .93 with 
an average of .76, A.D=.I2. Since for these same values 
P.E. ranges from .10 to .02 with an average at .057, the 
reliability of these values is adequate. 

It appears therefore that this list of words possesses the 
advantage of maintaining practically the same order of difficulty 
throughout the grades from the 3d to the 8th. In any grade 
the hardest word, the easiest word, and the words which 
take rank between tend strongly to hold their positions in every 



TO 5f€^^*r^ Abiiiif^ts Meosmrewiemi amd DistrSmium 



€/ibtrgndt. Onr fist then is to a marked degree 
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TABLE Vn 

CoEwnamm or CcmmMtJkxiom. Gsaob with Gsadk, axd Each 
GftJiDE WITH All Gsades for Each School^ Fntar 



School 

3dwitb4tb 

* - 6th 

* * (Hh 

* * 7th 

" * 8th 

" " entire fcfaool 

4tb • 6th 

* * Ml 

* « 7th 

* -^ 8th 

" ** entire scbool 

6tb * ftth 

" « 7th 

« « 8th 

'^ '^ entire scbool 

6tb " 7th 

« « 8th 

" ** entire icbool 

7th « 8th 

" ** entire school 

8tb ** entire school 

Average, grade with grade. . . . 

Average, grade with school . . . 



II 


111 


.37 


.78 


-26 


.66 


—.07 


.40 


.40 


.23 


.01 


.31 


35 


79 


.81 


.69 


.64 


.60 


.37 


.37 


.20 


.34 


7* 


,S4 


.72 


.60 


.60 


.69 


.62 


.48 


P^ 


M 


.66 


.66 


.62 


.60 


77 


77 


.46 


.76 


•75 


,6i 


.(5o 


'57 


.42 


.63 


.6p 


•7-/ 



IV 




67 
31 
45 
34 
47 

77 

61 
62 
60 
62 

M 

90 
88 
83 

S2 

94 

.86 
84 

.90 
7^ 

.^^ 
.67 



.69 
.71 
.76 
.76 
.67 

^5 

.89 
.84 
.73 

.77 

9^ 

.93 
.90 
.72 

95 

.89 
.89 

93 
.80 

.5/ 
.80 
.8g 



An 



-79 
.71 
.66 
.47 
-71 
.S^ 

.83 
.69 
.62 
.72 
-po* 

.90 
.86 
.93 

■98^ 

.90 
.89 
.88^ 

.89 

.pi* 
.76 

.8^ 
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TABLE VIII 

COBBBULTIONS OF SCHOOL WITH SCHOOL AND OF EIaGH SgHOOL WITH 

All Schools for Each Grade. First Preferred List 
School I i8 not included because of its different system of grading 



Grades 

School II with III 

II " IV 

II " V 

II « All 

« III « IV 

" III " V 

« III " All 

IV « V 

« IV « All 

« V " All 

Average, school with school — 

Average, each school with all 
s<3iooIs 



3d 
grade 


4th 
grade 


5th 
grade 


6th 
grade 


7th 
grade 


stb 
grade 


.45 
.32 
.61 

.62 


.60 
.74 
.82 
.76 


.82 
.66 
.87 

'93 


.55 

.78 
.60 

■S7 


.51 
.56 
.59 
.88 


.31 
.56 
.29 
.61 


.76 
.54 
.88 


.66 

.77 
.8q 


.60 
.79 
.87 


.73 

.78 
'73 


.62 

.47 

'77 


.60 
.50 

.61 


.77 
•S3 


.75 

•S4 


.78 
.82 


.67 
'93 


.60 
'S3 


.64 
'S3 


'S3 


.86 


'95 


'7S 


'79 


ss 


.58 


.72 


.75 


.69 


.56 


.48 


79 


.84 


8g 


'S3 


.82 


'73 



All 
grades 



70 
80 
88 
91* 

88 
81 
87* 

85 
82 



91* 



* These figures are for each school with all grades and schools combined, i.e., with all 
participants. 

A method in reading and word study which makes extensive 
use of the phonogram may possibly cause some words to become 
easy which are otherwise difficult. If the pupils in one school 
come from homes where English is not spoken, they may find 
difficult a set of words other than that which children of English- 
speaking parents find difficult. 

With the purpose of throwing some light on this point we 
shall consider what the correlation is between schools for each 
grade and for all grades with respect to the First Preferred List. 
Table VIII shows the correlation coefficients. The school-with- 
school average correlations range from 48 to .82 with a median 
at .69. The school-with-all-school averages range from .73 to 
.91 with a median at .83. A few of the coefficients throughout 
the table are low. There are, however, but six that are below 
.50. All but one of these are in the extreme grades (3d or 8th) 
and have to do with School II. The circumstances under which 
this school was examined account for this. The tests were given 
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immediately after the long summer vacation and the test-material 
comprised the Original List (270 words). The other schools 
were tested considerably later in the school year and the pupils 
in those schools wrote the Selected List (100 words). 

Notwithstanding these few shortcomings the 70 coefficients 
of Table VIII form an impressive argument for the value of the 
First Preferred List. We may fairly contend that not only 
are the positions of the words of this list relatively stable as 
between grades (Table VII), but that this permanency holds as 
between schools. 



§ 7. Examination of the Second Preferred List 

The second list of 25 words (see p. 13 or Appendix II) was 
examined in the same way that the first list was examined, i.e., 
with reference to correlations first between grades, and second 
between schools. 

At School I the correlations between grades were found to be 
as follows (Compare with similar tabulation for the First Pre- 
ferred List on|page 17: 



4th grade 


with 5th grade .87 


4th " 


" 6th " .83 


4th " 


" 7th " .79 


5th " 


" 6th " .95 


5th " 


" 7th " .78 


6th " 


" 7th " .83 




Average 84 




(P.E.— .04) 



For the other schools Table IX shows the correlations. It 
may be compared with Table VII (page 20). 

A comparison of Table IX with Table VII shows that 
although the word list to which Table IX refers was taken, on 
the basis of partial knowledge, to be somewhat inferior to the 
First Preferred List, these coefficients do not show it. The 
grade- vvith-grade averages (.66, .67, .60, .48, and .75) are higher 
for some schools than in Table VII and lower for others. Their 
central tendency is almost identical while the closeness of group- 
ing is greater for the second than for the first list. Of the 
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105 measures of correlatiqii in Table IX only 13 are less than 
four times their probable error, and only 3 are less than twice 
their probable error. The grade-to-gprade relationships for all 
schools (column 6) range from .40 to .95, average .75, A.D.= 
.14. This is satisfactory to a degree scarcely, if at all, less than 
is the showing for the first list. 



TABLE IX 

Coefficients of Corrsla.tion. Grade with Grade and Each 
Grade with All Grades for Each School. Second 

Preferred List 



School 


II 


III 


IV 


V 


All schools 


3d with 4th 


.60 
.69 
.61 
.43 
.51 

'73 

.73 
.74 
.60 
.57 
.82 

.75 
.55 
.62 
.81 

.83 
.82 

'93 

.80 
.88 

.8q 

.66 

,84 


.75 
.62 
.55 
.55 
.52 
.84 

.82 
.61 
.62 
.60 
.88 

.76 
.75 
.73 
.92 

.67 
.71 
.82 

.80 
'S3 

.80 
.67 

'87 


.55 
.56 
.55 
.41 
.35 

•75 

.69 
.44 
.45 
.51 
.78 

.74 
.73 
.72 
.go 

.79 
.77 
.84 

.74 
.80 

.81 

.60 

.81 


.38. 
.26 
.11 
.07 
—.01 

'34 

.48 
.40 
.38 
.38 
.67 

.84 
.65 
.83 
.p2 

.76 

.84 
.88 

.86 
.78 

.86 

.48 

'74 


.74 


« « 5th 


.73 


« " 6th 


.55 


« « 7th 


.40 


« « 8th 


.41 


** ** entire school 

4th " 5th 


.7^ 
.90 


« " 6th 


.80 


« " 7th 


.69 


« « 8th 


.62 


** " entire school 

5th " 6th 


.90 


« « 7th 


.83 


« « 8th 


.80 


** " entire sciiool 

6th ** 7th 


'9S* 
.94 


« « 8th 


.89 


" ** entire school 

7th " 8th 


.91^ 
.90 


** " entire school 

8th " entire school 

Average, grade with grade. . . . 
Average, grade with school . . . 


.87^ 
.80* 
.75 
.86* 



* These r-values are for each grade with all grades of all schools. 

Table X (whose counterpart for the first list is Table VIII) 
reveals, as Table IX did not, the relative inferiority of the 
second list. There are 49 coefficients in Table X that are lower 
than the corresponding figures in Table VIII. Only 21 are 
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higher. The sdiocrf-with-sdiool arerages are lower in five 
instatices and higher in bat two. The order of difficnhy of 
these words is therefore not so permanent as between schook. 
It is, however, sufficient abondandj to justify the list. There 
are but six of the 70 coefficients in die body of the table that 
are less than four times their probable error, and but three that 
are less than twice their probable error. In some respects, 
indeed, this list is superior to the first list A comparison of 

TABLE X 

CORBKLATIOlfS OF SCHOOL WITH SCBOOL AXD OF EaCH ScHOOL WIXB 

All Schools for Each Grade. Secdsu) Prbfcrrkd Lot 
Sdiool I not ifidoded. CompRie with Table Vm, p. 21 



Sdux)! II with III 

II - IV 

II - V 

II « All 

- Ill « IV 

- Ill - V 

** III - All 

« IV - V 

- IV - All 

V - All 

Average, school with achool — 

Average, each school with all 
schools 



3d 



48 
29 
05 

57 

55 

47 
76 

47 

79 

62 
39 



6q 



Ath 



51 

17 
08 
56 

38 
43 

7S 

43 

76 

57 
31 

68 



5th 



.47 
52 
52 

84 

82 
62 

78 

55 

74 

82 
.58 



,80 



sell 



65 
65 
55 

95 

60 
59 

80 

59 

75 

65 
61 

79 



7th 



60 
45 
43 

76 

61 
72 

85 

81 
65 

84 

60 



78 



8th 



.52 
.38 
.64 

83 

.67 
84 

84 

.66 

.6g 

,88 
62 



81 



AH 



66 
43 
60 
84^ 

59 

87 
88* 

65 
77* 

78* 

63 

8^ 



4> Theie figures are for eeeh echool with all sradee and bcImm^ combined, i.e., with all 
participant*. 

Tables III and IV shows that the words of the second list are 
in general more difficult than those of the first. Doubtless the 
first list is a somewhat better test for lower grades, while the 
second is a better test for upper grades. This supposition is 
neatly supported by the figures in Table X. Sixteen of the 21 
that are higher in this table than in Table VIII are in the three 
upper grades, while the two higher average correlations are in 
the 7th and 8th grades. If, therefore, some of the words in the 
first list are found to be too easy for the highest grades — as 
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doubtless they may be — ^then the second list will supply a valuable 
supplement to the first. 

§ 8. ConcliAsions Regarding the Preferred Lists 

Our lists therefore prove to be well selected. Success and 
failure in spelling them may be used with considerable confidence 
to measure the thing we call spelling ability. The establishment 
of this fact is of the utmost importance. In general when we 
are to measure mental traits or capacities the thing we directly 
measure is itself a physical phenomenon or fact. We measure 
fatigue by the number and height of lifts with the ergograph, or 
by the distance between points of the esthesiometer necessary to 
be recognized as * two.' We measure attention and perception 
by counting dots or by cancellation ; memory, by the number of 
digits reproduced; association by the number of words pro- 
nounced in a given time; and intelligence itself, by a series of 
tests which may be scored objectively. What we deal with 
directly is something, assumed to be functionally related to the 
trait in question, which can be measured in time or space or 
which can be counted. If this objective manifestation does not 
accurately raster the subjective state to which it is supposed 
to correspond, it is impaired, to the extent of its inaccuracy, as 
an index to be directly measured. 

Now it is undoubtedly true that the misspellings of most words N 
are unreliable as indicating lack of spelling ability in general; 
and on the other hand it is probable that to spell them correctly 
often argues little more than that the subject can spell the 
particular words that he did spell. Most words are in some way \ 
special — and they are special (particularly for children) in ways ' 
that we do not realize. Very often they do not mean the same 
thing to one person that they do to another. They are frequently 
pronounced differently by different people. They suggest dis- 
similar imagery. They connote variously. They range from 
very easy to very hard ; and those that are easy for some people 
are hard for others. Moreover there are numerous ways of 
misspelling them, each indicating its own causal incoordination. 
An error may not be equal to an error even in misspelling the 
same word. 
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It would be presumptuous to suppose that all these difficulties 
have been overcome in selecting our two preferred lists. Without 
doubt we have only roughly approximated the ideal conditions 
under which a physical fact may be the transcript of a mental 
trait Probably nothing more satisfactory than an approxima- 
tion can be devised. But we have been at no small pains to 
secure a list of words which would be free from many of these 
variations, and we think we have done so. From an inspection 
of them we may be justified in believing that their pronunciation 
and meaning are fairly constant for everybody; and we may 
regard it as probable that their associative connections do not 
vary much for different people. From a statistical analysis of 
them we find that their behavior with elementary school children 
is constant to a marked degree, and in particular that it is relative- 
ly independent of maturity and of local conditions. Older 
children in higher grades spell them more frequently and in each 
grade more frequently than in the one before it. Children in 
schools under favorable circumstances do better with them than 
do children in less favorable situations. It is because they re- 
flect these conditions that they are valuable. By the use of 
them, conditions in a school, a class, or an individual may be 
revealed ; and conversely to a certain extent if the conditions are 
known (e.g., the grade) the results, by the use of them, are pre- 
dictable. 

These lists, then, tend strongly to remain intact under various 
conditions. As lists they appear to be reliable, and our numerical 
results give quantitative expression to this reliability. But as 
to the words themselves, we shall yet have much to say. There 
has been no attempt to secure lists composed of words of equal 
difficulty. The effort has rather been to choose words which 
differ widely in this respect. We shall now attempt to arrange 
these words on a scale which shall accurately represent their 
difficulty, assuming as true a certain supposition concerning the 
.form of distribution of spelling ability within a school grade. 
The resulting scale will represent their difficulty approximately 
in so far as this supposition is approximately true. When this 
is done, their value for test purposes independently of the list 
which contains them will be established. 
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§ 9. Ratings of Individual Pupils 

In addition to scoring words, the papers of individual pupils 
were rated. This was done in the usual manner, the ability to 
spell one word being scored as equal to the ability to spell any 
other word of the list. This procedure is subject to the criticism 
made in Section i above; but in the absence of any evaluation 
of the words, a system of weighting is not possible. The results 
will not be misused here. 

The test material consisted of the 100 words of the Selected 
List. The papers written at schools II, III, IV, and V were 
used. School I was not available because of its system of grad- 
ing. A few papers were incomplete in each of the schools ; these 
were rejected in this part of the work. In all, 2,487 papers were 
rated. Table XI shows for each grade the distnbution of in- 



TABLE XI 

Distribution of Individual Ratings of Pupils in 
Schools II, III, IV and V 



Per- 


3d Grade 


4th Grade 


5th Grade 


6th Grade 


7th Grade 


8th Grade 


Ceut&Kv 

Correct 


No. 


% 


No. 
1 


% 


No. 
1 


% 


No. 


% 


No. 


% 


No. 


% 


0- 5 


9 


2.0 


.2 


.2 










6- 10 


22 


4.9 


1 


.2 


2 


.4 














11- 16 


30 


6.7 


10 


2.1 


1 


.2 














Id- 20 


38 


8.5 


12 


2.6 


2 


.4 














21- 25 


44 


9.9 


13 


2.8 


6 


1.2 


2 


.5 










26- 30 


47 


10.6 


23 


4.9 


12 


2.3 














31- 35 


34 


7.6 


29 


6.2 


13 


2.5 


2 


.5 


2 


.5 






3e- 40 


38 


8.5 


27 


5.8 


11 


2.1 












1 


41-45 


24 


5.4 


30 


6.4 


18 


3.5 


6 


1.4 


2 


.5 






46- 50 


34 


7.6 


33 


7.1 


28 


5.4 


4 


1.0 


1 


.3 






51- 55 


26 


5.8 


27 


5.8 


20 


3.9 


6 


1.4 


3 


.8 






56- 60 


24 


5.4 


31 


6.6 


32 


6.2 


15 


3.6 


5 


1.4 


1 


.4 


61- 65 


26 


5.8 


39 


8.4 


44 


8.5 


12 


2.9 


6 


1.6 


1 


.4 


66- 70 


17 


3.8 


29 


6.2 


48 


9.3 


23 


5.5 


8 


2.2 


3 


1.1 


71- 75 


13 


2.9 


45 


9.6 


49 


9.5 


30 


7.2 


18 


4.9 


8 


2.9 


76- 80 


8 


1.8 


35 


7.5 


59 


11.5 


52 


12.4 


31 


8.5 


11 


4.0 


81- 85 


4 


.9 


33 


7.1 


37 


7.2 


67 


16.0 


38 


10.4 


19 


6.9 


86- 90 


4 


.9 


26 


5.6 


64 


12.4 


61 


14.6 


79 


21.6 


41 


14.8 


91- 95 


3 


.7 


19 


4.1 


50 


9.7 


101 


24.2 


93 


25.5 


80 


28.9 


96-100 






4 
467 


.9 


18 


3.5 


37 


8.9 


79 


21.6 


113 


40.8 


Totals. . . 


445 






515 




418 




365 




277 




Medians. 




35.8 




60.70 




73.10 




84.90 




90.50 




94.68 


«Va Urn • • • 




18.0 




20.9 




10.4 




10.0 




7.9 




5.8 
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dividual ratings. It reads as follows : "In the 3d grade 9 pupils 
were rated between 0% and 5%, which was 2.0% of all the 3d 
grade pupils. In the 4th grade i pupil was rated between 0% 
and 5%, which was .2% of all the 4th grade pupils," etc. 

The striking characteristic of the distribution of these ratings 
is their extreme variability. Children of the 3d grade are repre- 
sented in every group but one, while children of the 4th and 5th 
grades are rated in every group. It appears that we may expect 
a few 6th- and Tth-grade children to spell not more than 20 or 
30 of these hundred words, which is not quite as good as the 
typical ability of 3d-grade children for the same words. The 
8th-grade pupils show the least variation. This is probably 
true of this grade in general. It is not, however, as marked as 
these figures indicate. The lOO-word list as a whole, whatever 
may be true about some of the individual words, did not thorough- 
ly test this grade. A glance at Fig. 6 will show how sharply cut 
off at the high end is the curve of distribution. This is against 
all the facts which we know about eighth-graders in particular 
and human ability in general. A harder test would have shown 
a lower mode and a more gradual tapering off at the upper end 
of the curve. But even as this record stands we may look for 
a considerable number — ^between 7 and 8 per cent— of Sth-grade 
pupils to average no better than the typical performance of sth- 
grade children. 

TABLE XII 
Distribution of iNorviDUAL Ratings Grouped to Show Modes. Figs. 1-7 



Peroentage 
Correct 

0- 10 

11-20 

21-30 

31- 40 

41-50 

61- 60 

61- 70 

71- 80 

81- 90 

91-100 



3d Grade 



6 
15 
20 
16 



.91 
22. 

.2j 

13.01 

[ 24.; 

11. 2j 

9.61 

[ 14.: 
4.7J 

1.81 

.7) '■ 



4th Grade 

I 5.1 
4.7) 

7.71 

19.7 
12. Oj 

13.51 

\ 25.fi 

12. 4j 

14.61 

[ 81.7 
I7.1J 

12.71 

\ 17.7 
5.0J 



5th Grade 

1^ 

3.51 

f 8.1 
4.6j 

17.81 

[ 38.8 
21. OJ 

19.61 

\ 32.8 
13. 2j 



8 
10 



6th Grade 



2 

5 

8 

19 

30 

33 



.51 
[ 1.0 

.5] 

.OJ 



7th Grade 



2 

8 

13 

32 

47 



.5J .5 

.81 

.2) '-' 

.01 



8th Grade 



1.51 

8.< 
6.9J 

:7} "•• 



6 
21 
69 
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FlG. I. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grade 3. 
Fig. 2. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grade 4. 
Fic. 3. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grade 5. 
Fig. 4. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grade 6. 
Fig. 5. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grade 7. 
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Fig. 6 
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Fig. 6. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grade 8. 
Fig. 7. Frequency of each rating (of per cent of Selected List spelled 

correctly) in grades 3-8 combined. 
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Another characteristic of the distributions shown in Table XI 
is the absence of clearly marked modes. Table XII is a group- 
ing of the per cent columns of Table XI into lo's and 20's. From 
this grouping wide modes of marked character are shown. 

Figs. I to 7 show the same facts graphically. From the nature 
of these figures the test material appears to have been capable 
of revealing satisfactorily the spelling ability of grades 3, 4, and 
5. Figs. I to 7 are the surfaces of frequency of spelling ability 
with the Selected List. In each of them the horizontal scale 
shows percentages correct ; the vertical scale shows the per cent 
of children having each rating for percentage correct, by steps 
of 10. The number of children represented is 445 in grade 3, 
467 in grade 4, 515 in grade 5, 418 in grade 6, 365 in grade 7, 
and 277 in grade 8. 

§ 10. Overlapping 

It follows as a matter of course from the variability of these 
ratings that the overlapping of g^de on grade is conspicuous. 
We have located the median abilities, of each grade, for the 
selected word list. They are: 3d grade, 35.8; 4th grade, 60.7; 
5th grade, 73.1 ; 6th grade, 84.9; 7th grade, 90.5 ; 8th grade, 94.7 
(See Table XI). Table XIII shows the number of pupils and 
the per cent of pupils in each grade whose ratings equalled or 
exceeded the medians of every other grade. The table reads 
as follows: In the 3d grade 76 pupils equalled or exceeded the 
median rating of the 4th grade which was 17.1% of all the 3d- 
grade pupils; 27 equalled or exceeded the median rating of the 
5th grade which was 6.1% of all the 3d-grade pupils. In the 4th 
grade 378 pupils equalled or exceeded the median rating of the 
3d grade which was 80.9% of all the pupils of the 4th grade, 
etc. It will be noticed that there are two places where there is 
no overlapping. There are no 3d-grade children who equal the 
median rating of the 8th grade, although the 3 who exceed the 
7th-grade median come very near it. Two of them are rated at 
93 and one at 94, only 1.7 and .7 below the 8th-grade median. 
There is also no overlapping of the 8th grade on the 3d. All the 
pupils of the 8th grade exceed the median of the 3d grade. When, 
however, we say that at these points there is no overlapping, 
we do not mean that their surfaces of frequency do not enclose 
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TABLE XIII 

Number and Per Cent of Pupils in Each Grade Whose Abilttt 
Equalled or Exceeded that of the Median Pupil 

IN Evert Other Grade 



3d grade. . . 
N=445. . . . 
Med.=35.8 

4th grade. . 
N=467.... 
Med.=60.7 

5th grade. . 
N=515. . . . 
Med.=73.1 

6th grade. . 
N==418. . . . 
Med.=84.9 

7th grade. . 
N=365. . . . 
Med.=90.5 

8th grade. . 
N=277. . . . 
Med.=94.7 



No. 

% 



No. 

% 



No. 

% 



No. 

% 



No. 

% 

No. 
% 



3d 
Grade 


4th 
Grade 


5th 
Grade 




76 
17.1 


27 
6.1 


378 
80.9 




146 
31.3 


478 
92.8 


370 
71.8 




414 
99.0 


384 
91.9 


338 
80.1 


363 
99.5 


354 
96.4 


328 
89.9 


277 
100 


276 
99.6 


269 
97.1 



6th 
Grade 



9 
2.0 



52 
11.1 



142 
27.6 



7th 
Grade 



256 
70.1 



241 
87.0 



3 
0.7 



27 

5.8 



73 
14.2 



142 
34.0 



200 
72.2 



8th 
Grade 








9 
1.9 



30 

5.8 



57 
13.6 



99 
27.1 



common areas. If Fig. i is placed on Fig. 8 so that the zero 
points coincide, it is evident that there is considerable area com- 
mon to both. We mean that the upper part of the 3d-g^de 
surface of frequency does not lap over the median point of the 
8th-grade surface, and that the lower part of the Sth-grade sur- 
face does not reach down to the 3d-grade median. There are 
many 3d-grade children who do better than the poorest Sth- 
grade children. 

The fact is, then, that except as between the 3d and 8th grades, 
some pupils of each grade perform like typical children of every 
other grade. Since this is true, it serves to fix the location of 
the frequency curves and medians for each grade with reference 
to each other. For the purpose of doing so we shall for the pre- 
sent assume that the distribution of spelling ability in each grade 
is "normal," i.e., is correctly represented by the curve of error. 

There is some argument for this assumption. The fact that 
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our surfaces of frequency (Figs. i-6) do not, especially for upper 
grades, closely resemble the normal curve, only shows that the 
test material was not difficult enough to bring out a distribution 
in real accordance with spelling ability. The result of using a 
diflferent list of words is shown for grades 6, 7, and 8 by Figs. 
8, 9, and 10. The test material in this instance was Rice's "Sen- 
tence Test" : 396 children in the 6th grade, 367 in the 7th, and 
244 in the 8th wrote this test in schools II, III, and VIII. The 
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Figs. S, 9 and 10. Frequency of each rating (of per cent of Rice Sen- 
tence List spelled correctly) in grades 6, 7 and 8, respectively. 
iV=^96 for grade 6; 367 for grade 7; and 244 for grade 8. The 
horizontal scale is for per cent spelled correctly; the vertical scale 
is for the percentage of children receiving each rating for percentage 
correct, by steps of la 



surface of frequency for the 6th grade is close to the "normal" 
surface. If that for the 7th and 8th grades is less so, it is still 
far more regular than the surfaces shown for these grades in 
Figs. 5 and 6 and might be made still more so by an appropriate 
selection of test material. There seems no good ground for as- 
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suming that the distritnition of spelling ability in any grade is 
not according to the normal curve or according to a curve which 
resembles it closely. ^^ 

§ II. Location of Grade Medians 

Upon the assumption, therefore, of a normal distribution we 
may proceed to locate the g^ade medians with reference to 
each other. In all cases we shall work with per cents instead of 
with numbers of pupils. This will reduce all surfaces of fre- 
quency to equal areas. We shall assume further that the real 
variability of any one of these graBes m spelling ability is equal 
to the real variability of any other one of them. 

We have already seen (Table XIII) that 17.1% of the 3d- 




A 

Fig. II. 



Showing the overlapping of the 3d and 4th grade surfaces of 

frequency. 



grade pupils equal or exceed the median ability of 4th-grade 
children. Fig. 11 shows this fact by a diagram. The surface 
on the left (Axis OM) represents the 3d-grade distributions. M 
is its median point, MD (=MQ) is its probable error — i.e., 
figure NPQD is one-half its area, thus graphically representing 
one-half the cases in the 3d grade, which accordingly do not 
deviate from the median by an amount greater than MD, The 
surface on the right represents the 4th-grade distribution beyond 
whose median axis, O^M^, the 3d-grade surface extends to an 
amovmt represented by the shaded figure KCM^. This stands 
for the 3d-grade children who equal or exceed the 4th-grade 
median — ^i.e., it is 17.1% of the 3d-grade surface of frequency. 
Accordingly the area OKM^M represents 32.9% of the cases. 
The distance MM^ may now be found in terms of P.E. It is 
the distance from the median point along the X-axis of the normal 
probability integral which includes 32.9% of the cases. Distances 
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corresponding to different per cents of the total area of the 
curve have been worked out. Table XIV, which is taken from 

TABLE XIV 

Tablb of Valubs of the Normal Probabilitt Integral Corre- 
sponding TO Values of P.E. Total Area of the 
Surface of Frequency Taken as 10,000 



X 






X 






X 






X 








No. 


A 




No. 


A 




No. 


A 




No. 


A 


f:e. 


CasM 




P.E. 


Cbocii 




PJL 


Caaes 




PJJ. 


Caaes 














81 






18 














136 


1.6 


3441 


80 


3.00 


4786 


17 


4.6 


4988 




.06 


136 


134 


1.56 


3521 


76 


3.06 


4802 


16 


4.56 


4989 




.1 


260 


134 


1.6 


3697 


74 


3.1 


4817 


14 


4.6 


4990 




.16 


403 


133 


1.66 


3671 


71 


3.15 


4831 


14 


4.66 


4991 




.2 


636 


134 


1.7 


3742 


69 


3.2 


4846 


18 


4.7 


4992 




.25 


670 


132 


1.76 


8811 


66 


3.25 


4868 


12 


4.76 


4993 




.8 


802 


131 


1.8 


3876 


63 


3.3 


4870 


11 


4.8 


4994 


.6 


.36 


933 


130 


1.86 


8939 


61 


3.36 


4881 


10 


4.86 


4994.6 


.6 


.4 


1063 


130 


1.9 


4000 


67 


8.4 


4891 


9 


4.9 


4995.2 


.6 


.45 


1193 


128 


1.96 


4067 


56 


3.46 


4900 


9 


4.95 


4995.7 


.6 


.5 


1321 


126 


2.0 


4113 


63 


3.6 


4909 


8 


6.0 


4996.2 


.4 


.56 


1447 


124 


2.06 


4166 


61 


3.65 


4917 


7 


5.05 


4996.6 


.6 


.6 


1671 


124 


2.1 


4217 


48 


3.6 


4924 


7 


5.1 


4997.1 


.3 


.66 


1696 


121 


2.15 


4266 


46 


3.66 


4931 


6 


5.15 


4997.4 


.3 


.7 


1816 


119 


2.2 


4311 


43 


3.7 


4937 


6 


6.2 


4997.7 


.3 


.75 


1936 


118 


2.26 


4364 


42 


3.75 


4943 


6 


6.25 


4998.0 


.2 


.8 


2063 


115 


2.3 


4396 


39 


3.8 


4948 


5 


6.3 


4998.2 


.2 


.85 


2168 


113 


2.36 


4436 


37 


3.86 


4953 


4 


6.35 


4998.4 


.2 


.9 


2281 


111 


2.4 


4472 


36 


3.9 


4957 


4. 


5.4 


4998.6 


.2 


.95 


2392 


108 


2.46 


4608 


33 


3.95 


4961 


4 


6.45 


4998.8 


.2 


1.0 


2600 


106 


2.6 


4641 


32 


4.0 


4965 


8 


6.5 


4999.0 


• A 


1.06 


2606 


103 


2.66 


4673 


29 


4.05 


4968 


3 


6.55 


4999.1 


• X 


1.1 


2709 


101 


2.6 


4602 


29 


4.1 


4971 


3 


6.6 


4999.2 


m X 


1.16 


2810 


98 


2.66 


4631 


26 


4.15 


4974 


3 


5.65 


4999.3 


• X 


1.2 


2908 


96 


2.7 


4657 


26 


4.2 


4977 


2 


6.7 


4999.4 


• X 


1.25 


3004 


93 


2.76 


4682 


23 


4.25 


4979 


2 


5.75 


4999.6 


.06 


1.8 


3097 


91 


2.8 


4705 


22 


4.3 


4981 


2 


5.8 


4999.65 


.06 


1.36 


3188 


87 


2.86 


4727 


21 


4.35 


4983 


2 


6.85 


4999.6 


.05 


1.4 


3276 


86 


2.9 


4748 


19 


4.4 


4986 


2 


5.9 


4999.66 


.05 


1.46 


3360 




2.96 


4767 




4.46 


4987 




6.95 


4999.7 
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Thorndike ('13, p. 200)', presents these distances in units of P.E. 
By reference to it we find that 32.9% corresponds to 1.4088 P.E. 
In a similar way, the 6.1% of 3d-grade children who equal 
or exceed the 5th-grade median (Table XIII) serve to locate 
that median at 2.2929 P.E. above the 3d-grade median. The 6th- 
grade median is 3.0441 P.E. and the 7th, 3.6429 P.E. above the 
3d-grade median. The distance between the 3d- and 8th-grade 
medians cannot be directly calculated owing to the absence of 
suiScient overlapping. 



MMM 



At* 



*lf *t^ A|^ />(, A|r 



B 



Suppose the line AB to represent the range of spelling ability 
in the elementary school. At a certain distance above A, the 
absolute zero-point, stands the 3d-grade median, M,. Above it 
and at distances to be determined are the medians of the 4th 

to the 8th grades, M^ Mg. For brevity we shall call the 

distance from the 3d- to the 4th-grade median Mj-4, etc. M^^ 
means the same distance as Mg^, but measured in the opposite 
or negative direction. 

TABLE XV 

Thb Per Cent of Pupils in Each Grade Whose Abiuty Equalled 
OR Exceeded that of the Median Pupil in Evert Other 
Grade; with the P.E. Values Correspond- 
ing to Each Per Cent 







3d 
Grade 


4th 
Grade 


5th 
Grade 


6th 
Grade 


7th 
Grade 


8th 
Grade 


3d grade. . . . 


% 
P.E. 




17.1 

1.4088 


6.1 
2.2929 


2.0 
3.0441 


0.7 
3.6429 



? 


4th grade. . . 


p1 


80.9 
—1.2962 




31.3 
.7227 


11.1 
1.8111 


5.8 
2.3308 


1.9 
3.0767 


5th grade . . 


P.fe. 


92.8 
—2.1663 


71.8 
—.8563 




27.6 
.8819 


14.2 
1.5888 


5.8 
2.3308 


6th grade. . . 


P.fe. 


99.0 
--3. 4600 


91.9 
—2.0735 


80.1 
—1.2632 




34.0 
.6117 


13.6 
1.6291 


7th grade . . 


P.fe. 


99.5 
-^.8200 


96.4 
—2.6673 


89.9 
—1.8918 


70.1 
—.7818 




27.1 
.9041 


8th grade .. 


p1 


100 

? 


99.6 
--3.9375 


97.1 
—2.8114 


87.0 
—1.6704 


72.2 
—.8730 
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Table XV gives all the distances between medians which our 
data permit us to calculate directly. The P.E. values, reading 
across the table, indicate that on the record of the pupils tested 
the 4th-grade median is fotmd to be 1.4088 P.E. above the 3d- 
grade median, the sth 2.2929 P.E. above it, the 6th 3.0441 P.E. 
above it, and the 7th 3.6429 P.E. above it; that the 3d-grade 
median is 1.2962 P.E. below the 4th-grade median, the 5th .7227 
P.E. above it, etc. 

It will be seen that M^ is given as 1.4088 above Af,, while M^ 
is given as only 1.2962 below M^, We shall have to adopt one 
or the other, or some value between them as the most probably 
correct distance, M,^. Similarly for each of the other distances 
(except M^^) we have two values, and these two values are in 
each case somewhat diflferent one from the other. The following 
are the pairs of values which Table XV shows : 



^.-4 


1.4088 and 1.2962 


^.-« 


2.2929 


a 


2.1663 


Afa-, 


3.0441 


u 


3.4500 


^a-7 


3.6429 


u 


3.8200 


M^ 


.7227 


u 


.8553 


M^ 


1.8111 


u 


2.0735 


M^ 


2.3308 


u 


2.6673 


M^ 


3.0767 


u 


3.9375 


M^ 


.8819 


u 


1.2532 


M^i 


1.5888 


u 


1.8918 


M^ 


2.3308 


u 


2.8114 


M^i 


.6117 


u 


.7818 


M^ 


1.6291 


u 


1.6704 


M^ 


.9041 


a 


.8730 



The differences between these pairs of values is in most 
cases small. In all cases they afford data for the determination 
of the distances between medians which will be probably more 
accurate than either of them. 

We do not, however, need all these values. If we have five, 
namely, M^^, M^, M^^, M^, and M^^, all the others may 
be obtained by adding these together. We shall therefore 
attempt to derive as accurately as possible these five values in 
terms of the unit, P.E. Each of them is represented directly by 
two quantities as shown above. But it is clear that if we use 
more of the data of Table XV we may obtain values whose 
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accuracy will be much more satisfactory. We may, for instance, 
find for the distance between the 4th-grade median and the 
5th-grade median (M^^) a third value by subtracting from the 
distance between the 3d- and Sth-grade medians (M^,^ = 2,2i)2g) 
the distance between the 3d- and 4th-grade medians (Jlf,^ = 
14088). This gives .8841. Another value is the diflference 
between the same two distances expressed negatively, i.e., accord- 
ing to our notation, between M^^ (2.1663) ^ind M^^ (1.2962;, 
which is .8701. Again we may use the difference between M^^ 
and Afg-^, between M^ and M^, between M^.^ and M^^; 
and for each of these differences between positive quantities 
we have a diflference between corresponding negative quantities. 
This adds six more expressions, making ten altogether, for the 
same distance, Af^^g. This is of course only a beginning of the 
great number of combinations which may be used to get expres- 
sions for the same distance. We think these few, however, 
since they use each of the 18 segments (nine counted both ways) 
which terminate at either M^ or M5 will be sufficient to determine 
Af 4^ with considerable accuracy. We doubt whether the remoter 
segments (e.g., M^^, -M^e-s* ^^d M^^) would, if used, increase 
the accuracy at all. 

Accordingly we have calculated 10 values for M^^, A^b-6> ^^^ 
M,^. Since we have no expression of direct relation between 
M^ and Afg, we have but 8 values for M^^ and M^^, Table 
XVI gives all these values with the derivation of each. It also 
gives the averages, unweighted and weighted, of the values for 
each of the five median intervals. 

It was felt that to give each of these items the same weight 
was to fail to take account of their reliability. The direct values 
are, no doubt, most to be depended upon. Those computed by 
using a distance which passes over one median are less so. Those 
involving two or more of these " skips " are still less so and 
diminish in reliability as the number of " skips " increases. It 
will be found that in column 2 of Table XVI the first quantity 
.8841 is derived by using a value that involves one skip. M^^ 
skips over M^, while M^^, which is taken from it, presents no 
skips. The second quantity, .7227, is direct, and there are no 
skips. .9292 involves one skip, .7420 three skips (Af^^ skips M^ 
and Me, and M^^ skips M,), etc. It will be found upon trial 
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TABLE XVI 
Direct and Derived Values of BIedian Distances in Terms of P.E. 








M^4 


M^ 


^s-« 


M^ 


A^7-.8 




1.4088 
(direct) 


.8841 


.7612 


.6988 

(M3^,-M3^J 


(M3_3-M3^) 




1 . 6704 


.7227 
(direct) 


1.0884 


.6199 


.7469 




1.2330 


.9292 


.8819 
(direct) 


.7069 


.7420 
(J»f^-3f„) 




1 . 3121 


.7420 
(Af^,-M^) 


.9771 


.6117 
(direct) 


1.0174 




(M^^M^^ 


.7469 

(J»f,_3-Af3_3) 


.7017 
(3f^-M3^) 


.7260 


.9041 
(direct) 




1.2962 
(direct) 


.8701 


1.2837 

(M^3~J»f„) 


.3700 


{M^^M^ 




1.3110 


.8663 
(direct) 


1 . 2182 


.6938 


1.2702 




1 . 3766 
(M,_3-M^) 


.8203 


1.2632 
(direct) 


.6386 


.9196 




1.1627 
(M^3-Af,^,) 


.7766 

(i»f7_-M,^) 


1.1100 
(3f„-M,^) 


.7818 
(direct) 


.8886 




? 


1 . 1261 


1 . 1410 

(3f3_3-M3^ 


.7974 


.8730 
(direct) 


Average 


1 . 3326 


.8471 


1.0406 


.6344 


.9201 


Wdghted 
Average 


1.3606 


.8363 


1.0606 


.6608 


.9101 



that in all values there are either o, i, 3, or 5 skips. We have 
weighted them 6, 4, 3, and 2 respectively (ratio about 1.5). 
This is, of course, pure assumption, nor do we know of any 
convenient plan of weighting which would not be. All we can 
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say is that to us the direct values seem to be quite one and 
one-half times as reliable as those involving a distance which 
passes over one median, that it seems reasonable the latter 
should be about as many times more reliable than those involving 
3 skips, and that the derivation with 5 skips would be inferior 
in approximately the same ratio. Weighting therefore as above 
indicated, we obtain values for the median distances as given in 
the last line of Table XVI. These are the measures that will 
be used in this study ; but they diflfer so little from those obtained 
without weighting that the latter may serve almost as well. 

Concretely these results mean that if we represent the diflFer- 
ence between no spelling ability at all and the ability of typical 
3d-grade children by x, the ability of typical 4th-grade children 
will be represented by ^+1.351, of typical 5th-grade children 
by JT + 1.351 +.836 or JT + 2.187, oi typical 6th-grade children by 
X + 3.238, of typical 7th-grade children by jt + 3.899, and of 
typical 8th-grade children by ;r + 4.809. (The determination 
of the value of x is not material in the present connection. We 
shall, however, have something to ofifer on this point in a later 
section.) The median distances suggest that so far as spelling 
is concerned the equal time intervals of one year between the 
grades do not at all correspond to the differences in ability. 
The difference between 3d-grade performance and 4th-grade 
performance is more than twice as great as the difference 
between 6th- and 7th-g^ade performance. Whether this is due 
to a more or less common failure in the 7th grade to give as 
much attention to spelling as in earlier grades or whether in 
general 6th and 7th grades are actually closer together than 
others, is a question which we cannot settle. That a lack of 
effort to instruct in spelling in the higher grades does not fully 
account for the differences is suggested by the fact that the 
8th grade stands at a greater distance from the 7th than the 5th 
does from the 4th or the 7th from the 6th. 

§ 12. Scaling the Words 

Assuming that the normal surface of frequency represents 
the distribution of spelling ability in each grade, we shall now 
seek to determine how difficult each one of the 50 words listed 
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in Tables III and IV is for each grade. A word spelled by one 
hundred per cent of the pupils in, say, the 3d grade would have 
no difficulty for that grade. The ability of all pupils would be 
greater than the ability required to spell it, and the entire area 
of the frequency surface would lie above it — i.e., to the right of 
it. In Fig. 12, if OP represents the Probable Error, it would be 
located theoretically at an indefinite distance to the left of the 
point O, a distance, however, which we may for practical pur- 
poses call 5 or 6 times as g^eat as OP — i.e., 5 P.E. or 6 P.E. A 
word spelled by 98 per cent of the pupils becomes more in- 
telligible. It would be located at a point K, a vertical at which 
(KL) would cut off 2 per cent of the area of the entire fre- 
quency surface. The point K will be found to be at a distance 




Fig. 12. Normal Surface of Frequency. 

of about 3 P.E. below the median O, i.e., at 3 P.E. A word 
spelled by nobody — i.e., a word rated at o — would be at, say, 
+ 6 P.E., and a word spelled correctly by 50 per cent of the 
group would be located at the median O, that is, at a point 
above and below which are an equal number of cases. 

It will be interesting and will serve to show the misleading 
character of per cent ratings to observe what we mean by 
saying that one word is more difficult than another. Observe 
the two following groups of words taken from Tables III and IV 
for the 3d grade: 



(A) 



Per Cent 
Correct 



tailor 38 

lesson 37 

another 36 

wear 35 



(B) 

beautiful 

beginning 

telephone 

pigeons , 



Per Cent 
Correct 

10 

9 
8 
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According to the ratings of these words the differences in 
point of difficulty between the words of group A are equal to the 
differences in group B, for the differences are all represented 
by I per cent. Habitually we are likely to think that this is true. 
But such a way of thinking quite neglects the form of distribu- 
tion of spelling ability. In fact it assumes that the frequency 
surface is a rectangle — i.e., that there are just as many very 
poor or very good spellers as there are spellers of meditmi 
ability. This we know is not true. The mediocre are always 
much more numerous than the dull or the gifted. A figure such 
as Fig. 12 takes account of this fact. 

Now the words in group A are much nearer the median 
(which would be a word 50% correct) than are those of group 
B. They are located on the base line at points such that between 
adjacent verticals drawn at these points one per cent of the 
area will lie. The words of group B, more remotely placed 
with reference to the median, are also so situated that between 
their adjacent verticals one per cent of the area will lie. But 
the points for group B stand at greater distances apart than 
do the points for group A because the verticals or ordinates are 
shorter for the remoter group. As a matter of fact, the differ- 
ence in difficulty between " beautiful " and " pigeons " is more 
than twice as much as the difference in difficulty between 
" tailor " and " wear," although each difference is represented by 
the same per cent. 

Bearing in mind the meaning of these per cent values we may 
readily place the 50 words of Tables III and IV along the 
.r-axis or base line of a normal frequency surface. " Even," 
which is rated 59 per cent for the 3d grade, would be at a point 
below the median between whose ordinate and the median ordin- 
ate is 9% of the area of the surface. Calling the median zero and 
referring to Table XIV, we find that 9% of the cases (900 in 
10,000) corresponds to a value of P.E. which lies between .3 
and .35. By interpolation this value is found to be .338. There- 
fore the position of " even " is at — .338 P.E. This may be repre- 
sented on Fig. 13 by the point i. " Lesson " (37% correct) will 
be at a point above zero between which and zero are 13% of 
the cases of a normal frequency surface. Table XIV locates 
this point at +.49 P.E. (Point 2, Fig. 13). "Only" (65% 
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correct) is at — .572JP.E. (Point 3, Fig. 13) ; " smoke" (46%) 
at +.148 RE. (point 4); "pear'* (31%) at +.735 P.E. (point 
5) ; " minute " (26%) at +.955 P.E. (point 6) ; " cousin " (19%) 
at + 1.300 P.E. (point 7), and so on. Words rated above 50% 
are located below the median: those under 50% are above the 
median. Their distances from the median are negative in the 
first case and positive in the second. 

Assuming the same form of distribution for the 4th grade 
we find that "even" (79%) is located at — 1.20 P.E., "only" 
(75%) at precisely — i.oo P.E., and " pear " (42%) at +.30 P.E. 
Similarly for each grade by using the per cents of Table III and 
IV and the P.E. equivalents of Table XIV we may " place " all 




4 

Fig. 13. Showing the placing of the first 7 words of the Preferred 

List 3d grade. 

the words. Table XVII gives the per cents and P.E. equivalents 
of the 50 words of the Preferred Lists which from now on will 
be treated as one list. Figs. 14, 15, 16, 17, 18 and 19 show how 
the words appear when arranged on a linear scale for each 
grade. For the meanings of the numbers, each of which refers 
to a word of the Preferred List, see Table XVII or Appendix II. 
Table XVII with its correspcwiding figures (14 to 19) aflFords 
standards for grade performances. As will be observed, the P.E. 
values of all the words are calculated for each g^ade with refer- 
ence to the median of that grade, which is called zero. Their 
use may be illustrated with reference to the 4th grade. We may 
test a pupil of that grade by beginning with the easiest word and 
proceeding to the next hardest and the next and so on. The 
series would run : i even, 3 only, 2 lesson, or 5 front, 28 chicken, 
or 41 Tuesday, 4 smoke, 1 1 pretty, 8 bought, ... By the time 
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Scaiing the Words 
TABLE XVII 



Word 




dYair 


4th Year 


5th y 


„, 


fllh Ymr 


7th Year 


8th Ymr 


% 


P,E, 


% 


P.E. 


% 


P.E. 


% P.E. 


% 


P.E. 


% 


P.E. 


























—2.789 






























2w-::::S 
















































5 






1-1 






— 1 


•tw 


90—1.900 


U4 


—2.305 


VI 






















Rfl 




M 


-2,306 
















































































(ony « 


+ -037 


82 


— .453 


lii 


-~ 


bii 




)U 
































-2. 305 
















































































5 


coiuin 19 






+ .112 










8. 




























—3.083 


M 


- .597 
















































































20 


Bword 13 


+ 1.670 


46 




57 


— 


KUl 


78-1-146 


8« 
























8. -1.415 
























































































3S 




i-.m 


61 
































m 






+ .22* 


77 


— I.OM 
















































































ao 


circus 20 












(WO 


72 ~ .864 


;b 


























42 


+ .209 




















































































Uilor 38 


+ .463 




- ,187 


7U 


— 


iVM 


























414 


aal— .492 








—1.476 


















































































Kwd M 








M 
















^1 












_ 


UK? 


so- 1,348 


H7 


—1 670 


ni 


— i.ess 
















































































46 


aniner 27 


+ .90fl 






87 


— 


6JUi 


Bfl— l.fl02 


90 






















73R 


85 -1.537 


W 




97 






















































































+ 1.900 


bli 


- 074 




~ 












—2.587 



we have reached 13 button, 22 touch, 50 beautiful, 12 wear, and 
48 instead, we are dealing with a group of words which 50 per 
cent of 4th-grade children spell correctly. The performance of 
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a given 4th-gra(le pupil should approximate at least the standard 
set by these words. If we are asked, "What is 4th grade sj^fiUuig 
ability?" we may answer that it is the ability to spe ll thes e 
words that cluster about the median. Of course it is to be 
expected that any given pupil will miss some of the easier words 
and spell some of the harder words. We should test him by the 
whole series of 50 and his errors for words below the median 
may be balanced against correct spellings of words above the 
median at an approximately equal distance. He may miss 
49 raise ( — .15 P.E.) but spell 20 sword or 21 freeze (+.15 P.E.). 
He may miss 16 naUs, but spell 7 pear. In such cases he should 
be credited with having spelled the easier word. 

In a similar way, by using the words in the order in which they 
are placed for any other grade, we may determine whether a 
child is as good a speller as the median children of that grade. 
We do not need, however, to use the median as a standard tmless 
we wish to. We may choose + 40 or + 60 and ascertain whether 
children are able to spell up to that point in the same manner as 
is indicated above for the zero-point. It is to be observed, 
however, that our series does not offer a very satisfactory test in 
the higher grades for such standards, because there are so few 
words that are placed as high or higher than +40 or +60. 
The words, in short, are not difficult enough for this purpose. In 
a later section of the paper we shall introduce harder words into 
the series precisely with the object of affording a fuller test of 
ability for the higher grades. 

There remains, however, for the present one other use which 
may be made of our data. We may wish to disregard grades 
altogether and seek an answer to the question, In general, how 
hard are these words for children of the elementary school above 
the 2d year? or, with reference to a graphical representation, 
What is the average position of each word on a linear scale — 
that position from which the positions for each grade deviate 
by the smallest amounts? 

To answer such a question we shall have to use one point 
of reference for all grades instead of a different one for each 
grade. In the above treatment we have expressed each word- 
value as a deviation from the median of the particular grade 
we were considering. We shall now use this same data but 
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transfer the point of reference to the third-grade median by 
using the median intervals which were derived in Section 11. 
In Table XVI (page 39) we have given the results of our inquiry 
into the amotmts of these intervals as follows : 



From Mj to M^ 


1.351 P.E. 


" M3 " M , 


2.187 " 


" M3 « Af e 


3.238 " 


" 3f 3 « My 


3.899 « 


" M3 " ilf 3 


4.809 " 



Table XVIII gives, for each of the 50 words, its position for 
each grade when referred to the 3d-grade median as the zero- 
point or point of reference, together with the " average 
position " of each word. The method of securing these figures 
may be illustrated as follows: 

From Table XVII the P.E. values of the word " even " for 
each grade, referred to its own median, are shown to be 



3d grade, 


— .337 


4th " 


—1 . 196 


6th « 


—1.819 


6th « 


—2.188 


7th " 


—2.188 


8th " 


—2.789 



The first of these values is of course already referred to the 
3d-grade median. To refer the others to the same point we must 
increase each of them by the amount by which each grade 
median stands above the 3d-g^ade median, i.e., we must find the 
sum (algebraic) of — 1.196 and 1.351, of — 1.819 and 2.187, 
of — 2.188 and 3.238, of — 2.188 and 3.899, and of — 2.789 
and 4.809. These sums give the figures of Table XVIII for the 
word " even." Their arithmetical mean is taken as the average 
position. 

Fig. 20 shows the averages of Table XVIII when reduced 
to a scale. The noticeable thing about these tabular and graphic 
representations is the fact that the words from easiest to hardest 
diflfer so little. The words "even" and "only" (No. i and 
No. 3), which are — .337 and — .571 respectively for the 3d 
grade, appear above the zero point at +.699 and +.569. 
Similarly the word "too" (No. 39) which for the 8th grade 
alone is + 5.07 becomes for all grades only + 3.491. It is a fact 
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TABLE XVIII 

The Position op Each Word in Each Grade when Referred to the 3d- 

Grade Median as the Zero-point; and the Average Position of 

Each Word for All Grades, when so Referred. 1=P.E. 



Word 
Num- 
ber 

1 
2 
3 
4 
5 
6 
7 
8 
9 
10 

11 
12 
13 
14 
16 
16 
17 
18 
19 
20 

21 
22 
23 
24 
25 
26 
27 
28 
29 
30 

31 
32 
33 
34 
35 
36 
37 
38 
39 
40 

41 
42 
43 
44 
45 
46 
47 
48 
49 
SO 



Word 



even 

lesson 

only 

smoke. . . . 

front 

sure 

Eear 
ou^t. . . 
another. . 
forty 

pretty 

wear 

button . . . 
minute. . . 
cousin. . . . 

nails 

janitor . . . 

saucer 

stopping. . 
swoni 

freeze 

touch 

whistle. . . 
carriage. . 

nor 

already. . . 
be^nning 
chicken . . 
choose . . . 
circus 

grease... . 
pigeons. . . 
quarrel.. . 

saucy 

tailor . . . . 
telegram . 
telephone 
tobacco . . 

too 

towel . . . . 

Tuesday. . 

tying 

whole 

against. . . 
answer. . . 
butcher . . 
guess . . . . 
instead. . . 

raise 

beautiful . 



3d 


4th 


5th 


6th 


7th 


8th 


Grade 


Grade 


Grade 


Grade 


Grade 


Grade 


—.337 


.155 


.368 


1.050 


1.711 


2.020 


.492 


.487 


.772 


1.250 


1.594 


2.212 


—.571 


.351 


.368 


.797 


1.110 


1.359 


.149 


.616 


.650 


.933 


1.302 


1.359 


—.037 


.487 


.937 


1.338 


1.594 


2.020 


.112 


1.164 


1.452 


2.093 


2.080 


2.504 


.735 


1.650 


1.888 


2.374 


2.597 


2.504 


.376 


.780 


.991 


1.250 


1.594 


2.020 


.531 


1.612 


1.042 


1.636 


1.594 


2.212 


.037 


.898 


1.616 


2.374 


2.484 


3.139 


.187 


.699 


1.140 


1.338 


1.999 


2.504 


.571 


1.388 


1.773 


2.284 


2.424 


2.621 


.693 


1.277 


1.733 


2.329 


2.945 


3.139 


.954 


1.804 


1.734 


2.142 


2.297 


2.726 


1.302 


1.463 


1.452 


1.419 


2.080 


2.370 


.261 


1.052 


1.367 


1.568 


1.816 


2.212 


1.302 


1.650 


1.888 


1.936 


2.597 


2.909 


1.819 


2.171 


2.486 


2.939 


2.703 


3.507 


.909 


1.765 


2.000 


2.418 


2.852 


3.334 


1.670 


2.500 


1.926 


2.093 


2.297 


2.621 


.820 


1.500 


1.494 


1.823 


2.297 


2.504 


.187 


1.277 


1.811 


1.936 


2.424 


2.621 


1.145 


1.164 


1.963 


2.707 


2.899 


3.272 


1.670 


1.727 


2.187 


2.586 


2.597 


3.272 


—.492 


.937 


1.616 


2.545 


2.803 


2.504 


1.475 


1.650 


2.448 


2.785 


4.123 


3.713 


1.988 


2.351 


2.679 


3.387 


3.287 


3.809 


.037 


.573 


.772 


1.338 


1.302 


1.359 


1.145 


1.963 


2.261 


2.862 


3.328 


3.452 


1.248 


1.765 


2.187 


2.374 


2.899 


2.370 


1.819 


2.708 


2.679 


3.809 


4.198 


4.548 


2.188 


2.171 


2.524 


2.977 


3.121 


3.452 


1.537 


1.765 


2.075 


2.238 


2.297 


2.504 


1.602 


1.922 


2.563 


3.164 


3.079 


3.664 


.453 


1.164 


1.409 


2.238 


2.597 


3.334 


1.537 


2.086 


2.601 


2.746 


2.990 


3.334 


2.083 


1.922 


2.261 


2.586 


2.485 


3.139 


1.742 


1.765 


1.811 


2.238 


2.157 


2.212 


1.602 


2.215 


3.096 


4.285 


4.677 


5.070 


1.047 


1.575 


1.656 


2.329 


2.754 


2.504 


.149 


.573 


1.535 


1.990 


2.229 


2.821 


.224 


1.052 


1.409 


2.545 


2.852 


3.139 


1.415 


1.612 


1.656 


2.093 


2.424 


2.909 


1.302 


2.129 


2.038 


2.238 


2.424 


2.504 


.909 


1.463 


1.535 


1.636 


1.999 


2.020 


.652 


1.014 


1.452 


1.701 


1.999 


2.020 


1.248 


2.044 


2.224 


2.586 


2.803 


3.272 


.693 


1.425 


1.734 


1.636 


2.229 


2.821 


1.196 


1.202 


1.535 


1.763 


1.711 


2.504 


1.900 


1.277 


1.409 


1.701 


I 1.594 


2.212 



Average 
Position 



.699 
1.135 
.569 
.835 
1.057 
1.568 
1.958 
1.169 
1.078 
1.758 

1.311 
1.844 
2.026 
1.943 
1.681 
1.379 
2.047 
2.604 
2.213 
2.185 

1.740 
1.709 
2.193 
2.340 
1.652 
2.699 
2.917 
.897 
2.502 
2.141 

3.294 
2.739 
2.069 
2.666 
1.866 
2.549 
2.413 
1.988 
3.491 
1.978 

1.550 
1.870 
2.018 
2.106 
1.594 
1.473 
2.363 
1.756 
1.652 
1.682 
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then that for these words the influence of higher grades is to 
make easy words harder and of lower grades to make hard 
words easier. That is, grade considered, these words are harder 
for children of the upper grades than they are for those of 
the lower grades. There are at least two reasons for this 
condition. 

First, as a rule these particular words are taught in the 
lower grades. A popular speller, taken at random, presents 
31 of the 50 words in the 3d year's work, 10 in the 4th, 2 in 
the 5th, and none in higher grades. There is nothing to lead 
one to suppose that this is peculiar. The words were among 
those chosen, it will be remembered, as at least in the speaking 
vocabulary of 3d-grade children. Most of them if taught at all 
will be taught in that grade. We may assume therefore that 
the 3d-grade record is somewhat aflfected by the recency with 
which these words have been presented. The succeeding grades 
will to some extent be discriminated against in the record. 

Second, the necessary basis of selection for these words from 
the larger lists would make it impossible for the words to take 
the same position on the scale for all grades. Consider a word 
which was spelled correctly by 50% of the 3d-grade children. 
Such a word would be at M 3. In order to take the same position 
on the 8th-grade record it must be as far below M^ as is the 
distance, already determined, between M^ and M^ or — 4.809 
P.E. To do this it would have to be spelled correctly by 9994 
pupils out of 10,000 (Table XIV), i.e., it would be 100% correct. 
But such a word would not have been selected, because it is not 
difficult enough in the 8th grade to be of any value as a test of 
ability. On the other hand, a word missed often enough in the 
8th grade to be satisfactory as a test (say, 90% correct) would 
have to be less than 1% correct on the 3d-grade record in order 
to take the same position on the scale. Such a word would have 
been of no use as testing 3d-g^ade ability and would have been 
rejected. 

The fact is that the span from 3d to 8th grade is — if our median 
distances be correct — ^too great for any list of words to be in all 
respects satisfactory. We need several lists each of which shall 
be given to three or four consecutive grades and overlapping 
on one another — e.g., one for 2d, 3d, and 4th grades, another 
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for 3d, 4th, 5th and 6th grades, and another for 5th, 6th, 7th 
and 8th grades. An attempt will be made in a later section to 
do this and to show the results that may be expected. 

§ 13. The Use of the Scale 

Meanwhile, however, we venture to think that the scale as 
5hown in Fig. 20 is important and valid within its range. It 
may be used in several ways of which at least three are 
important. 

1. It may be used just as it is without reference to the fact 
that the words are not separated from each other by equal 
intervals. We know the value or weight to assign to each word. 
We shall therefore not make the mistake of assuming that all 
the words are of the same value, as is the usual school practice. 

2. Certain words of the series may be used which diflfer from 
each other by approximately equal steps. 

TABLE XIX 

Words Abbanged in Order of DnrpicnLTT Accordino to the Scale 

AND Their P.E. Values 



No. on 
Soale 


Word 


P.E. X 100 


No. on 
Scale 


Word 


P.E. X 100 


3 


only 


57 
70 
84 
90 
106 
108 
114 
117 
131 
138 
147 
155 
157 
159 
165 
165 
168 
168 
171 
174 
176 
176 
184 
187 
187 


14 
7 
40 
38 
43 
13 
17 
33 
44 
30 
20 
23 
19 
24 
47 
37 
29 
36 
18 
34 
26 
32 
27 
31 
39 


minute 

pear 


194 


1 


''***/ 

even 


196 


4 


smoke 


towel 


198 


28 
5 


chicken 

front 


tobacco 

whole 


199 
202 


9 
2 


another 

lesson 


button 

janitor 

quarrel 

s^inst 

circus 


203 
205 


8 
11 


bought 

ppettv 


207 
211 


16 


nails 


214 


46 


butcher 

Tuesday 

sure 


sword 


219 


41 
6 


whistle 

stopping 

carriage 

cniess 


219 
221 


45 
25 


answer 

nor 


234 
236 


49 


raise 


telephone 

choose 

telegram 

saucer 


241 


15 


cousin 


250 


50 
22 


beautiful. . 

touch 


255 
260 


21 


freeze 


saucv 


267 


10 


fortv 


already 

pigeons 

beginning 

orrease 


270 


48 
12 


instead 

wear 


274 
292 


35 


tailor 


329 


42 


tyinflT 


too 


349 




** rf ""o 
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3. Small groups of words may be so selected as to be 
equally difficult as groups ; or they may be so selected that their 
group-difficulties constitute an ascending series from easy to 
\ hard, differing by equal amounts. 

1. By the first of these methods the entire series would be 
utilized or so much of it as in any given case would thoroughly 
test the subject. The order of the words of the series as given 
in Figure 20 is shown in Table XIX in the first colimm and in 
the second column the test values or weights of these words 
are given. 

2. If it is desired to use a scale whose words differ in 
difficulty by equal steps, the arrangement as shown in Table 
XX will be found convenient. 

TABLE XX 
A Ten-point Scale 



J i,-i* (** 



No. of 

Word 

(Fig. 20) 



9 
11 
45 
35 
30 
37 
34 
27 



Word 



only. . 
smoke. 



- i» 7 



1 :" 



another 



!."-» 

• ^ 



f I. 



pretty — 
answer. . . 
tailor . . . . 

circus 

telephone. 

saucy 

beginning. 



q : 






^;' 



-*^ fc 



F£. X 100 



1 j 






j G ^ 

I 9^1 






57 

84 
108 
131 
159 
187 
214 
241 
267 
292 



27 
24 
23 
28 
28 
27 
27 
26 
25 



To this series may be added 39 *' too " whose P.E. x 100 is 
349 and which differs from " beginning " by 57 or approximately 
two steps. 

In the series of Table XX the average step is 26.2 with an 
A.D. of 1.3; or if the word "too" is included the average step 
is 26.6 with an A.D. of 1.4. This is quite accurate enough for 
any use to which the scale is likely to be put. If this conclusion 
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is accepted, these eleven words may be used to express our 
judgments of other words concretely and in terms that every- 
body can understand. We should not then have to resort to 
such terms as " hard," " easy," " rather difficult," " very hard, 
etc., but we may judgfe a word to be " as hard as ' another,' 
" equal in difficulty to * beginning,' " " as hard as * answer ' but 
not as hard as 'tailor,'" etc. It is very desirable that other 
words should at some time be added to the scale at both ends. 
There are many words harder than " beginning " or " too " and 
there are others easier than " only," although the latter do not 
constitute much of a school problem. Neither set, however, 
could be used over a range as wide as 3d to 8th grades. 

3 (a). It is often desirable to oflfer tests of equal difficulty, 
but of different words at various intervals of time to the same 
g^oup or to the same individual. We may thus secure a progress 
record. In spelling, however, this has proved to be very difficult 
if not impossible. We can never be sure that the second or 
third test is equal in difficulty to the first test. In fact we may 
be pretty sure it is not. To give the same words over again is 
often valueless because of the added special familiarity with 
them. The following lists therefore are offered as lists of equal 
difficulty. The sum of the P.E. values in each is 976 or 977. In 
using them the words may be weighted as indicated, or may, with 
no g^eat loss in precision, be each given a credit of i. 

Number Number 

in Preferred in Preferred 

LiBt Weight List Weight 

Group A Group B 

41 Tuesday 16 45 anfiwer 16 

10 forty 18 48 instead 18 

40 towel 20 43 whole 21 

44 against 22 17 janitor 21 

47 guess 24 24 carriage 24 

Group C Group D 

49 raise 17 21 freeze 18 

22 touch 17 12 wear 19 

42 tying 19 7 pear 20 

14 minute 20 13 button 21 

18 saucer 27 20 sword 22 

Group E Group F 

16 nails 14 8 bought 12 

46 butcher 15 11 pretty 13 

15 cousin 17 19 stopping 23 

29 choose 26 37 teleimone 25 

32 pigeons 28 34 saucy 27 
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(b) It may also be desirable to test, not with single words, 
which only in the long run may be expected to conform to the 
positions assigned to them, but with groups of words whose 
difficulties as groups differ by constant amotmts. Such a series 
of groups arranged from easy to hard would themselves con- 
stitute a scale — a sort of Binet-Simon scale for measuring ability 
in spelling. On the analogy of the Binet-Simon scale we might 
easily fix upon a certain minimum performance for a group at 
which or better than which a subject might be allowed to have 
" cleared " that group and might pass on to the next. He mi^t 
also be given additional credits for spelling words in groups 
above the highest one which he cleared. 

The groups are arranged in order of difficulty, Group I being 
the easiest and Group \^II the hardest. Within each group the 
four words are also arranged in their order of difficulty begin- 
ning with the easiest. Since, however, within each group the 
words differ little in difficulty, they may be taken as having 
equal weights without material error. It is true that Group VII 
is not nearly as satisfactory in this respect as the others, differing 
between the first and fourth words by 1.08 P.E., whereas the first 
six groups have a range of but .225 on the average. 

Group I P.E. xlOO Group IV P.E. x 100 

3 only 57 10 forty 176 

12 we&T 

42 tying 

38 tobacco 



1 even. . . 

4 smoke . 

28 chicken 



70 
84 
90 



184 
187 
199 



Average. 

Group II 

5 front 

9 another 

2 lesson 

8 bought 



Average. 

Group III 

16 nails 

46 butcher 

41 Tuesday . . . . 

6 sure 



75 

P.E. X 100 

106 
108 
114 
117 

HI 

P.E. X 100 

138 
147 
155 
157 



Average. 

Group V 

33 quarrel 

30 circus 

24 carriage 

47 guess 



Average. 

Group VI 

29 choose 

36 telegram . . . . 

34 saucy 

26 already 



Average . 




149 

Group VII 

37 telephone . 

32 pigeons . . . 

31 grease. . . . 

39 too 



Average 



Average. 

P.E. X 100 

241 
274 
329 
349 

298 



186.5 

P.E. X 100 

207 
214 
234 
236 

223 

P.E. X 100 

250 
255 
267 
270 

260.5 
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The average differences in difficulty between these groups in 
succession are 36, 38, 37.5, 36.5, 37.5 and 37.5. This is probably 
the most important use of the scale, for present school practice. 

If it is true that the general scale (Table XVIII and Fig. 20) 
may be used in these three ways — as a whole, by words selected 
to be at equal intervals, and by grouping words so that the groups 
are equal or diflfer by equal amounts — ^then it is also true that 
each of the grade scales (Figs. 14-19) may be used in like 
manner each for the grade to which it applies. It is probably 
true, moreover, that the grade scales will more closely fit real 
conditions in any given instance than will the scale for all grades. 
The labor of making selections and groupings of words for 
these scales is not great and may be made by any one on the 
analogy of the method used above. 

§ 14. The Zero-Point of Spellity Ability 

As has been suggested in previous sections, we have only suc- 
ceeded in scaling by means of these 50 words a limited segment 
of the entire projection representing spelling ability. Our list is 
essentially an easy list, testing that ability only to a moderate 
degree. Words like " fatiguing," " guarantee," and " conscien- 
tious" (Rice Sentence Test) would stand much higher in the 
scale and require a considerable extension of it to the right; 
while such unfamiliar words as " eurycerous," " delitescence," 
and "gallinaceous" (Klein, '12, pp, 388, 389) would take still 
higher positions, passing quite beyond the range of the ability of 
elementary-school children. 

On the other hand, our scale is as certainly limited at the low 
end. There are many easier words than any we have used so far. 
Such words would reach far down on the scale towards the place 
where the absolute zero-point lies. But they would have been 
totally unfit for use in the higher grades. In fact, with the wide 
range of ability between 3d and 8th grades, it is surprising that 
we find any words at all which will aflford a test at both 
extremes. 

Without seeking to determine the limit of the high end of 
the scale — perfect spelling ability — it is quite possible, and 
theoretically very desirable, to find the limit of the low end, i.e., 
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to sod doe point vhere speilxng abQitj jnst begins to be a positive 



How far, ihez:^ bexiw &e jd-grade nwlian, wfaich has hitfaerto 
been ocr ;<:ic:t cf refercaoe, is die akohite zero-fKHnt? 

In ordfcr to azuvtr dds qocstioo, a test was given to diildren 
of the 2d. 3d, azd ^dx grades. It ooosisted of 50 words in 
semexices. Nzzj£Ceen of these had already been nsed in die 
Selected List ' loo word lirCj ; and, of these, 6 had been diosen 
for the Preferred Liit. Tbej had all been speDed, about 40 per 
cent or niore correct, bj the third-grade children. The remain- 
iz^ 32 words were ±oc^hr to be among the easiest in the 
langiage: he, is, cc the. 10. of, for, day, etc 

Thev x^ere '^n hno seneoces as follows and dictated at 
schooU II asd \TII: 



Easy 30-\Vgid Test 

1. y'srfi a:iQ A^fl*- am zimim-z. 

2. He is on the rcM jn^d is Atmost iur£ to pass in front of me. 

3. / lend for hrn every da\. 
4- Go into the school. 

5. But do not touch the tcble, 

6. He alzo has only one pair of shoes. 

7. They are not a/ all pretty. 

8. .Vo ffKin ought to j/c-j/ rrm a penny. 

It seems clear that a child who cannot spdl any one of these 
words has substantially no spelling ability. Since our study is 
limited to written words we shall sav, therefore, that for our 
purpose a child who does not, save by chance, write a single 
word of this list so that it can be recognized as correcdy spelled 
has no abilit}-. 

On account of the marked improvement in spelling of children 
in the latter half of the second school vear over those in the 
first half of that year, we have treated the two half-years of 
the 2d grade separately, calling the lower half 2a and the upper 
2b. We shall proceed as follows. We shall find the distance 
between the 3d-grade median and the 2&-grade median and the 
distance between the latter and the 2a-grade median. Then if 
there are children of the 2a grade who utterly break down and 
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fail to write any word correctly we shall find their place in the 
2a distribution. 

Table XXI shows the records of individual pupils according 
to their rating in the Easy 50- Word Test. Note the fact that 
no children of the 4th, 3d, or 2b grades wholly failed in this 
test. In 2a, however, 39 children were rated 10% or less, and 
of these there were 8 pupils who were actually marked zero. 
This is 4.6% of all the children of 2a. 



TABLE XXI 

Distribution of Individual Ratings. East 50-word Test 

Table reads: in 2a 39 children, or 22%, were rated between and 10%; 
32 children, or 18%, were rated between 11% and 20%, etc. In 26 5 chO- 
drm, or 3%^ were rated between 11% and 20%, etc. 



Par Cent Gorreet 

0- 10 

11-20 

21-30 

31-40 

41-60 

61-60 

61- 70 

71-80 

81-90 

91-100 

Totals 

Medians 



2a Grade 



No. 



39 

32 

37 

27 

18 

14 

6 

2 

1 





175 



22 
18 
21 
16 
10 
18 
3 
1 



.6 



26.50 



26 Grade 



No. 




5 

9 
29 
26 
47 
31 
14 
7 
1 



169 





3 

5 

17 

16 

28 

18 

8 

4 



.6 



56.17 



3d Grade 



No. 





1 

4 

7 

11 

25 

33 

36 

30 

21 



168 





« 

2 
4 
7 
16 
20 
21 
18 
13 



6 



72.50 



4th Grade 



No. 











4 

13 

29 

60 

86 

134 



316 











1 

4 

9 

16 

27 

42 



88.12 



The medians for the grades are as follows : for 2a, 26.50% ; 
for 2b, 56.17%; for 3d grade, 72.50%; and for 4th grade, 
88.12%. The rapid rise of spelling ability from low second 
through the fourth grade is remarkable. It is much greater 
than the improvement during the next four years. Although 
the interval in time between 2a and 2& is but half a year, the 
medians suggest that the increase in ability between these grades 
is greater than it is between any consecutive yearly grades above 
the second. Further analysis will more precisely confirm this 
inference. 

Proceeding as in the case of grades 3 to 8, we show in 
Table XXII the amount and per cent of overlapping of each 
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grade beyond the medians of the other grades, together with 
the corresponding linear segment in terms of the Probable Error 
as a unit. 

TABLE XXII 

Amount and Per Cent of Overlapping with P.E. Equivalentb. 

East 60-word Test 



4thGnuie 



2a grade. 



26 grade. 



3d grade. 



4th grade. 





2a Grade 


26 Grade 


3d Grade 


No. 

p1 


■ • • • 

• • « • 

• • • • 


17 

9.71 
1.9254 


3 
1.71 
3.1429 


No. 


160 
94.67 
2.3932 


• • • • 

• • ■ • 

• • • ■ 


22 

13.02 
1.6690 


No. 

A 


165 
98.21 
3.1143 


140 
83.33 
1.4341 


• • • • 

• • • • 

• • • • 


No. 
P.E. 


316 
100 
? 


308 
97.47 
2.8976 


262 
82.91 
1.4094 






? 

4 

2.37 

2.9395 

30 

17.86 
1.3649 



From these results, Table XXIII is computed. The object in 
this table is to show how, by using all the data of Table XXII, 
various values of the median intervals may be obtained whose 
averages will be the most probably correct values. The interval 
between the medians of 2a and 2b is written M2ar2b; that 
between the medians of 2b and the 3d grade is written Af 2&-3 ; etc. 

It may be remarked parenthetically that in the number 1.3771 
of Table XXIII for the difference between the 3d- and 4th- 
grade medians, we have a striking confirmation of the substan- 
tial accuracy of our results as shown in Table XVI. The 
corresponding number is there given as 1.3505. That these should 
differ by so little when carried out upon different test material 
is exceedingly satisfactory. 

According to Table XXIII, the 2&-grade median is approxi- 
mately 1.35 P.E. below the 3d-grade median. The 2a-grade 
median is about 1.87 P.E. further below, or 3.22 P.E. below the 
3d-grade median which we have thus far used as our origin or 
point of reference. 

But we have not yet reached the point of zero ability. T)rpical 
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TABLE XXIII 

Valuss of Msdian Imtbrvals and Their Dbrivation 

(2a-^4TH Grade) 



Af,a-a6 


^a6-3 


M^ 


1.9254 
(direct) 


1.6690 
(direct) 


1.3649 
(direct) 


2.3932 
(direct) 


1.4341 
(direct) 


1.4094 
(direct) 


1.4739 


1 2176 


1.2706 


1.6802 


1.5746 
(Af,^^-Af,^ 

.7211 

1.4882 
(Af^5-Af^) 


1 4636 
(^4-a6 ^»-a6) 


Averages 1.8682 


1.3518 


1.3771 



2a children have some ability, namely, according to our record, 
an ability to score 26.5% in the Easy 50- Word Test. The 
children of that g^ade who were unable to write any word 
correctly were 8 in number, representing 4.6 per cent. These 8 
are included in the 39 rated between zero and 10% (Table 
XXI). Assuming that 2a children are grouped about their 
median according to the ''normal" distribution, we find that 
in order to cut oflf 4.6% from the low end we must take a point 
2.5 P.E. below the median, (See Table XIV). This brings the 
zero-point at 5.72 P.E. below the 3d-grade median (3.22 + 2.5). 
This figure, 5.72 P.E., can only be taken as approximately 
correct. It would be somewhat influenced by an increase of the 
number of children tested. There is, however, no reason to 
suppose that the children ip schools II and VIII were unusual 
The testing in grades 3 to 8 in all other schools shows that 
results in these two schools do not materially differ from the 
general results. In both central tendencies and variabilities they 
are a fair average. There seems, then, to be no good reason 
why we should not consider the ratings of children in these 
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Mjb<x/lt at tyyyjiL h rr.-^M ut 'wjcot kk nsod, homewcr, dial the 
dai^ificadirjd of d^fldrts aao gravies s a brood ooe. Jost as we 
i^Ami it tktctiAZiy to trear ^d-jcar dnkiren in half-jearty 
M:c:tyjcii« !</ we iboo^l fiad thai ttsdng 2Z tbe hfgi ii niiig even 
of a 2C^'wttk lam wodid jidi ztsshs^ ts^iexiaStf m die low 
frad», quite diSertnt from tbose obcaiDed bjr ttstiag toward 
ti^t doM; of the term. Aoa>rdxx3g)T, tbe inaddie of the term is 
the b»t time at wfaicfa to find typical mndrtinos. Moreover, 
m r/r4tr ttal the results ciajr be cocnparable, die tesdi^ of all 
ip'ades sbaald be dooe at the same time. If 2a duldren were 
tested towards tbe eod of their term in diat grade, wink 2b 
Aihirtn wtrt testtd towards the beginning of theirs, the median 
intcrvH wonld be undnly shortened. A consideraMe addition 
to the reliability of our resohs is foimd in the fact that all 
children were tested during die loth wedc of a 20-week term. 

We may therefore oondude that the intervals between grades 
2a, 2b, 3 and 4 are substantially as found in Table XXIIL But 
as to the distance of the zero-pcHnt bdow the 2a-grade median, 
we cannot be precise. Four and six-tenths per cent of die 
2a children got no word right. As many as 22 per cent wrote 
less than 6 words correctly. Some of diem probably spelled 
diese few simple words corrccdy by mere chance. If this were 
true, they would have practically no spelling ability. The 
situation Ls more complicated than die above analysis indicates. 
If we were to assume that all the children who wrote 0-5 words 
corrccdy had practically no spdling ability (written), die zero- 
point would then be but 1.15 P.E. below die median instead 
of 2.5 P,E. If we were to assume that some of these children — 
*ay those who wrote no more than 3 words correctiy — had zero 
ability, we should find that 29 of the 39 in Table XXI were 
included. Such an assumption would place our zero-point at 
1.44 below the median. There are reasons for thinking that 
this is not far from the true position. The best judgment, there- 
fore, that we can make from our data and from our knowledge 
and experience of school conditions is, that the zero-point is 
about 1.5 P.E. below the 2a median, or about 4.72 P.E. below 
the 3d*grade median. 

We may summarize our results, then, in Table XXIV and 
Fig, 21, as follows: 
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TABLE XXIV 
Median Intervals. Zero to 8th Grade Median 



Succeasiye 


Distance 


Intervals 


Above 


1.50 


1.50 


1.87 


3.37 


1.35 


4.72 


1.35 


6.07 


.84 


6.91 


1.05 


7.96 


.66 


8.62 


.91 


9.53 



2a grade 

2b *" 

3d « 

4th " 

5th « 

6th « 

7th « 

8th « 



Fig. 21, page 62, shows these facts graphically. 

§ 15. Observations on the Distributions Shown in Fig. 21 

It is to be remembered that in Fig. 21 the eight surfaces of 
frequency constructed on each median vertical are theoretical 
and not according to the record. Moreover, they express the 
assumptions that for each grade the distribution of ability in 
spelling is strictly " normal " and that the real variability is 
alike in all grades. In a later section we shall take up the matter 
of applying to our results distributions which are not normal. 
Meanwhile, however, it will be interesting to observe how satis- 
factory a strictly normal form of distribution proves to be. To 
the extent that it expresses the same or nearly the same facts 
as the record (so far as it should, if valid, do so), it shows its 
value. 

1. In Fig. 21 the 2a surface of frequency does not reach the 
4th-g^ade median ; but it only falls short a little. According to 
the record in the Easy 50- Word Test no 2a child did as well 
as the median 4th grade child. But the best 2a record was 82% 
which is only a little less than M^ (88.12 by Table XXI). 

2. In the graphic showing the 3d-grade distribution does not 
quite reach the 8th-grade median. Similarly the record shows 
that no 3d-grade child obtained a score equal to 94.68 which 
(Table XI, p. 27) is M^ for the Selected 100- Word List; al- 
though 3 third-grade pupils had scores in the 91 to 95 group. 
(Table XI, column 2.) 

3. By the figure we see that the low end of the 8th-g^de 
distribution falls short of M j but not of Af^. In the record the 
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same is true, although the poorest 8th-graders surpassed the 
median of the 3d grade by more than the figure would indicate 
(See Table XI, page 2y). 

4. The 2b curve at its low end does not reach zero (record). 
No 3d-grade child was rated o in the Easy 50- Word Test (Table 
XXI, p. 57). 

5. The most remarkable thing in the figure is the fact that 
the high end of the 2a-grade distribution extends above the low 
end of the 8th-grade distribution. Even with all the recent 
information about retardation, acceleration, mental defect, and 
precocity combined with mis-grading and forced promotions, 
some critics will be hardly prepared to believe that any children 
classified in the first half of the second year of school life can 
do as well in spelling as the poorest who are classified in the 
8th (last elementary) year. This, however, the figure shows; 
and there is good evidence in our record to support it. We 
cannot compare these extreme grades directly because they did 
not write the same test. But in Table XI (page 27) we observe 
that for the Selected List one 8th-gra(}e pupil is in the 56-60 
group. As a matter of fact his paper was rated at exactly 56%. 
Therefore all the 3d-grade children in groups above 51 to 55 did 
as well or better. This proves to be 22.5% of the 3d-grade 
children. It is remarkable that between one-quarter and one- 
fifth of our 3d-g^ade children do as well or better than the 
poorest 8th-grade child. But this is not all. In the Easy 50- 
Word Test the highest 2a score was 82%. Only 38 out of 168 
3d-grade children, or 22.6%, did better. See Table XXI, page 
57. (The one child in group 81-90 in the 2a column was 
rated 82. In the 3d-grade column, of the 30 in group 81-90 and 
the 21 in group 91-100 combined, 38 were rated above 82%.) 
We therefore find that the best 2a child and the poorest 8th- 
grade child are equalled or surpassed by the same group of 
3d-grade children, — i.e., 22j49fc. Hence the best 2a child and 
the poorest 8th-grader of our record do have the same ability. 
To show this fact, the 2a curve should pass slightly beyond the 
low end of the 8th-grade curve, as in fact it does. This may 
seem to be drawing over-fine conclusions, but it is probable that 
the real overlapping is as great as the record shows. If, out 
of so few 2a children (175), one was found who scored 82%, 
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it is likely that, with a much larger niunber, there would not only 
be more children at 82% but some at even higher rating. 
Similarly it is likely that if a much greater number of 8th-year 
children had been tested some would have obtained less than 
56%. To the extent that either one or both of these proba- 
bilities were true, the overlapping would somewhat exceed that 
which the record suggests. 

6. After the argument of the last paragraph it need hardly 
be said that there is both in the graphic representation by theory 
and in the actual record an overlapping of every grade distribu- 
tion on every other from low 2d to 8th. 

The location of the zero-point enables us to draw some inter- 
esting conclusions which were not possible before. A few of 
these will be briefly stated. Taking the medians of each grade 
as indicating typical abilities, regarding the estimated zero-point 
as the true one, assuming normal distributions and equal real 
variabilities for all grades, and defining " to spell twice as well " 
as "to spell words of twice as much difficulty," Fig. 21 shows 
that 2b children are more than twice as good spellers as 2q 
children, and that 3d-graders are about three times as capable, 
and 4th-graders 4 times as capable. Fifth-grade children spell 
twice as well as 2b children. Eighth-g^ade children are only 
twice as good as 3d-g^ade children. This last statement means 
that typical children who have reached the 3d grade have half 
as much spelling ability as is required of the average child in the 
last year of the elementary school. 

We have in Fig. 21 a representation by which the entire range 
of difficulty of spelling words, appropriate to the elementary 
school, may be shown. The notation below the base-line shows 
the positions within that range taken by the 10 words of our 
scale which stand at equal intervals upon it (Table XX, 
page 52). Since these words include both the easiest word 
(" only ") and the hardest (" too ") of the entire scale they show 
its total spread. It will therefore be seen to what extent the 
statement is true which was made at the beginning of Section 
14 to the effect that with these 50 words we have only suc- 
ceeded in scaling " a limited segment of the entire projection 
representing spelling ability." By actual measurement it 24)pears 
that this s^^ent is but a trifle more than one-fifth of the entire 



Supplementary Testing cU Schools VI and VII 65 

projection. It will now, however, become apparent that no 
greater s^;nient could have been so scaled reliably from the 
limited material at our disposal. By reference to Fig. 21 it will 
be seen that no words easier than " only " could have been used 
and still have been clearly within the 8th-grade distribution. On 
the other hand no word that scales much higher than " too *' 
could have been used and still have been clearly within the 3d- 
grade distribution. With, say, ten thousand children of each 
grade tested each with a longer list, a wider spread could have 
been obtained. The series of fifty words which we used spreads 
over nearly the whole of the base-line common to both the 3d- 
and 8th-grade curves. 

It is evident, therefore, that much remains to be done to perfect 
a scale which shall pretend to completeness. Some of this fur- 
ther scaling will be undertaken in a later section of this mono- 
graph. A great deal must be left for later studies. A great 
many more words must be used both to fill in the gaps within 
the present scale and to extend its limits. Our main purpose has 
been to show the theory and technique required. 

§ 16. Supplementary Testing at Schools VI and VII 

After the data thus far given were in hand the same test 
material was used in two other schools. The results of this 
supplementary testing are now given. The Selected List (100 
words) was dictated during the fall term of 1912 at schools 
VI and VII to 1770 children. Two of the assistants in psy- 
chology at Teachers College acted as examiners, and the papers 
were then scored for individual ratings, but not for word ratings. 
Table XXV gives the distribution of these ratings and the grade 
medians for these two schools. Table XXVI gives the com- 
parisons by g^des of the combined results in schools VI and VII 
with those in schools II, III, IV, and V taken together. The 
comparison shows that in general schools VI and VII did not do 
so well as those tested earlier. On the average the grade medians 
are nearly 6j4 per cent lower. 

To one who would expect close conformity to our previous 
individual ratings in the case of any school taken at random, 
this discrepancy will be disappointing. But to one who recog- 
nizes the wide variability among schools in every subject, the 



66 Spelling Ability — Its Measurement and Distribution 
TABLE XXV 









Selected (100) List 






































No. % 


No. 


% 


No. % 


No. % 


No. 


% 


No. % 




69 22.7 


in 


3.4 


1 .3 


3 1-2 


n 







11- 20 


58 19.1 


:i2 


m.H 


6 1,7 


6 2.0 


2 


.« 





21- 30 


65 21.4 


■/» 


9.8 


12 4.1 


8 3.2 


? 


(t 











11.5 


24 8.3 










41-60 


29 9.6 


40 


13 5 


31 10.6 


13 5,2 


3 


9 


1 .3 


61- 60 


17 5.6 


;>i 


17,6 


41 14.1 


23 9.2 


13 


3 9 


3 1.0 














41 


12.2 




71-80 


6 2.0 


29 


9 « 


53 18.3 


51 20.4 


66 


16 fi 


16 5.6 


61- 90 


1 .3 


•/.b 




58 20.0 


51 20,4 


114 




97 33.1 


91-100 





7 


2.4 


18 6.2 


61 24.4 


101 


30.0 


169 64.3 


ToUb,.. 


304 


296 




290 


250 


337 




293 ^ . 


UediaDB. 


26.27 




61.76 


67.67 


79.36 




84.86 


91.96 



TABLE XXVr 

CoifFARisOK OF REStTLis Obtained in Schoou VI and VII with 

TaosE Obtaikso in Schools II, III, IV and V 

Figures show per cent of pupils in each grade who were rated 0-10, 11-S 









3aG™,i. 


.,bG,.d. 


Ml, G™U, 


6th Grade 


7tl, Grade 


8th Grade 


Per Cent 


III. 

IV, V 


Soh. 
Vll 


Ik 

IV. V 


Sch. 

vii 


iv"v 


Sch. 


iv"v 


Sch. 

vii 


^li':- 

iv.'v 


Sch. 

Vl. 

VII 


III, 

IV. V 


Sfh. 

vii 


0- 10 

a - 30 

Iji 

B -100 




; 


3!o 

1.2 


21 
5 


9 


2:4 

sio 




A 

sis 

iris 
13:2 


nil 

9"S 


33 


5 

? 


■!:l 

20.4 

20,4 
M-4 


47 


\ 


■1 

3C 


B 

1 
8 








3 


Uedli 


"■■ 


■ 


3S.«0 


2S.27 


60.70 


S1.7S 


73, !0 


67,67 


S4.90 


79.36 


BO.M 


S4.8fl 


B4.e8 


01.08 



difference will occasion no surprise. We should do well also to 
bear in mind not only that schools do vary greatly, but that in 
this particular instance there was a constant factor tending to 
lower the ratings. In the supplementary test the dictation was 
^ven by a stranger; in the original test by the class teacher, 
guided by printed directions. Leaving out of account any sugges- 
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tion of unfair methods on the part of teachers for the purpose of 
making a showing, this fact is quite sufficient to account for a 
falling off of results in schools VI and VII without supposing 
them to be much, if any, inferior to the others in the ability of 
their children to spell. The teacher has but one class to examine 
and she takes her time. She doubtless takes full advantage of 
the direction permitting the reading of a sentence " in whole 
or in part as many times as may be necessary to secure its full 
comprehension." She knows her class. The peculiarities or 
defects of pupils are her daily concern and she modifies her 
appeal accordingly. The children are at ease in her presence. 
They know her voice and manner of speaking; and they more 
readily imderstand her than they would another. In these 
matters they are placed at a disadvantage when examined by a 
stranger. 

We should expect this disadvantage to be most evident in 
the lower classes; and an inspection of the medians of Table 
XXVI shows how strikingly this is true. The children of the 
3d grade fell off 10.5% ; of the 4th, 9% ; of the 5th, 6th, and 7th 
approximately 5.5% ; and of the 8th only 2.5%. The force, 
whatever its nature, tending to depress the results at schools VI 
and VII was clearly operative to a greater degree in the lower 
classes and to a much less degree in higher classes. The effect of 
a change from the class teacher to a stranger as examiner would 
be expected to bring about results of just such a nature. 

But the obvious advantage of having the same examiner for 
every class (in this case there were two working together) is that 
however the results in general may be lowered, there is a better 
opportunity to compare class with class or grade with grade, 
or school with school. 

The real reason why this supplementary testing was under- 
taken was to verify the median intervals that had been derived 
from the original testing. The fact of classes being examined 
by the same persons is of g^eat value for this purpose. If, with 
this factor of the examiner made constant, we find that these 
median distances in spite of a falling off of grade performances 
remain substantially the same, we shall be justified in feeling that 
our former results are reasonably reliable. 
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In Table XXVII we g^vc the number and per cent of pupils 
who equal or surpass the medians of other grades than their 
own with the corresponding P.E. values. In this table are com- 
bined the children who were examined at schools VI and VII 
with those examined at schools II, III, IV and V. It is to be 
compared with Table XV (page 36). Table XXVIII gives the 
median distances as derived from the P.E. values of Table 
XXVII. Compare with Table XVI (page 39). The average 
distances, 1.37, .87, .90, .66, and .86, are to be compared with 
the values for the same distances as derived on page 39, namely 
(correct to 2 decimal places) 1.35, .84, 1.05, .66, and .91. Only 
in the case of M^^ is there an important diflFerence. The average 
difference, including that of Af 5-e, is .05 ; excluding it, the average 
difference is but .025. The entire range from Afj to Af » is found 
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to be 4.66 as compared with 4.81 according to the primary 
testing. These correspondences are, we feel, quite close enough 
to establish the essential reliability of our original figures. 
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§ 17. Arrangement of the Words of the Preferred List by 

Teachers^ Judgments 

A certain order of difficulty of the 50 words of the Preferred 
List having been determined as the result of testing in five 
schools and to a certain extent verified by a record from two 
other schools (Table XIX, and Fig. 20), a comparison of the 
result with an arrangement of the same words based on the 
judgment of teachers becomes interesting. It has an important 
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htuiogfAi tikt whole s{>eflii^ sitsatioo bccaose it is bj indhri^^ 
yoApacDX a^ to the dTffimhj of words that lists are made up 
and graded for elates, scfaoob, or ijsteiiB of schools How 
far such grading is reliabk majr be gathered faj finding out to 
what extent indiridnal judgment sqnares with the results of 
actual testily. 

For this porpose the 50 words of the Pr ef erre d List were 
arnu^ed alphabetically and distributed to a nmnhrr of teachers. 
Thejr were asked to arrange the words in wiiat tiigr judged to be 
dieir order of difficult for children to ^^dl, beginning witfi 
the easiest. They were particularly requested to do die work 
withottt consulting any one. Two hundred arrangements were 
secured. They differed widely — so widely that whatever may 
be the valtie of a consensus of many individuals, the trust- 
worthiness of the judgment of a sin^ teadier ^>pears to be 
almost of no value. It may be good and it may be bad; and it 
is about as likely to be the one as the other. With one notable 
exception, the agreement with the record was doser for tiie 
easiest and hardest words than for those of medium di£Bculty. 
This might have been expected from the fact that, as shown in 
Fig. 20, the words at the ends of the scale differ by larger 
amounts than do those nearer the middle. The excq>tkm 
referred to is the word " too," which, although it was in every 
school the hardest word to spell, was by more than a fourth 
of the teachers judged to be actually the easiest, or next to tiie 
easiest, in the list. The deviation of individual judgments from 
die record is shown by figures taken from a random sampling of 
tiie two hundred teachers' arrangements. FK'c such arrange- 
ments being taken by chance from the whole number, proved to 
be those of teachers No. 7, No. 88, No. 109, No. 134, and No. 
178. They ranked the 5th, loth, 15th, 20th, .... 50th words 
C record) as follows: 

RufiTd 5, 10, 15, 20, 25, 30, 35, 40, 45, 50 

No. 7 22, 15, 1, 31, 34, 33, 38, 47, 14, 10 r=+0.09 

No. 88 15, 9, 4,41,13,24,33,35,20, 1 r=+0.15 

No. 109 9, 11, 18, 39, 35, 36, 22, 25, 29, 10 r^+0. 15 

No. 134 24, 22, 23, 20, 6, 44, 7, 42, 35, 11 r— 0.03 

No. 178 21, 2, 7, 22, 14, 29, 49, 38, 28, 1 r=r+0.2 
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It is, however, to be expected that when a large number of 
judgments are taken together, wide disagreements with a true 
arrangement will tend to disappear, and a resultant will be 
obtained that may be expected to be closer to the facts than 
any single judgment would ever be likely to be. The statistical 
treatment of the 200 judgments was based on the theorem, 
" Differences that are equally often noticed are equal, unless the 
differences are either always or never noticed." It is an abbre- 
viation of the method used by Professor Thorndike in deriving his 
scale for Handwriting and by Dr. Hillegas in his similar work for 
English Composition. We have not felt the necessity of making 
comparisons of the judgment of each word with that of every 
other word, because the nature of our material has enabled us 
to derive our scale by a more direct method. Since we are here 
concerned with a comparison only, we have been content to 
proceed as follows: The record shows "only" to be easier 
than " even." What per cent of the individuals who arranged 
the words for difficulty so judged? As between "even" and 
" smoke " ; " smoke " and " chicken " ; " chicken " and " front " ; 
etc., what per cent of the judgments indicate that the first word 
of each pair is easier than the second, as the record shows ? The 
following is found to be true for the first six words : 

"only" was judged easier than "even" by 38.5% of the judges, 

"even" " " " " "smoke" ^' 67.5% " " 

"smoke" " " " " "chicken" " 72.0% " " 

"chicken" " " " " "front'* " 48.0% " " 

"front" " " " " "another" " 53-0% " " 

Now when the difficulty of a word is judged by a very great 
number of judges some will overestimate its difiiculty, others will 
tmderestimate it. Those who make small errors will be more 
nmnerous than those who make large errors. The frequency 
of the judgments will take the form of the curve of the proba- 
bility integral whose base-line represents the amounts of difficulty 
which the word in question is judged to have. The point on the 
base-line which corresponds to the greatest frequency of judg- 
ments represents the central tendency of the judges in rating 
the word. It is therefore the point which represents the difficulty 
of the word as determined by individual judgments. Two or 
more words may be compared for difficulty if we know the per 
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cent of judges who rate one word easier (or harder) than the 
other. 

Fig. 22 shows the curves for the first six words arranged to 
show the per cent of " easier " judgments noted above. The 
curve for " even " is so placed that 38.5% of its area is to the 
right of YO — ^the median axis of the curve for " only " when that 
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46 
47 
48 
49 
50 



axis is produced ; 67.5% of the curve for " smoke " is to the 
right of Y^O^ produced; 72% of the curve for " chicken " is to 
the right of Y^O^ produced ; and so on. H O^ is the difference 
in difficulty between " only " and " even " ; K 0*, between 
" even " and " smoke " ; P 0», between " smoke " and " chicken " ; 
S 0\ between " chicken " and " front " ; and 7 0^ between 
" front " and " another." When less than 50% of the judges 
r^^rd the first of a pair of words as easier, the second is, of 
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/ 3^ f 



Fig. 22. Diagram showing difference in difficulty between words by 

Teachers' Judgments. 
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course, judged the easier, and the difference in difficulty is a nega- 
tive one. Such is the case in the only-even and chicken^front 
pairs. The scaling of these six words is diagrammatically shown 
in Fig. 22 by producing each median vertical to meet the line AB, 
It will be seen that the order of difficulty is not the same as 
the order obtained by testing. 

Table XXIX shows for the entire 50 words the per cent of 
teachers who judged each word easier than the following word 
and the rank of each word for difficulty by record and by 
teachers' judgments. In spite of the fact that the opinion of 
single teachers is so unreliable, the combined judgments of a 
group as large as 200 yield an arrangement which agrees closely 
enough with the arrangement by record to confirm and support 
the latter in no small degree. The correlation, by the * foot-rule ' 
method, is found to be 0.79, which may quite properly be 
regarded as satisfactory. 

It may be worth while to point out, however, that in practice 
the selection and arrangement of words for teaching are not the 
work of a large number of individuals. These things are usually 
done by a single teacher for a class or by a text-book writer for 
as many classes as use his book. Not two hundred, probably not 
even ten, persons judge as to the selection and arrangement of 
the words in the lists now used in most schools. The length of 
such lists, moreover, would seem to preclude the possibility of 
a satisfactory judgment as to difficulty by individuals. Probably 
if our own list of 50 words had been shorter, the teachers would 
have worked more accurately. The several thousand words in 
a spelling-book certainly constitute a list about which there may 
be expected to be wide and numerous disagreements. We alluded 
in Section 3 above to our attempt to secure for school use a 
5000- word vocabulary graded by years and based upon the agree- 
ments of five spelling-books. This task proved to be very difficult 
precisely because of the total absence of agreement as to grading 
in the case of hundreds of words. One speller would assign 
words to the third grade which another would put in the sixth, 
seventh, or eighth. Gradings three, four, and even five years 
apart occurred with remarkable frequency. 

The obvious way (and the necessary way, it would seem) to 
grade words for difficulty is not by some one's opinion of how 
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hard they are, but by actually " trying them out." In matters of 
handwriting and composition the judgment of individuals is all- 
important, because merit in either is precisely a matter of judg- 
ment. One sample is better than another only because competent 
persons think so. On the contrary, one word is harder to spell 
than another not because we think so, but because more people 
misspell the one than the other, or because it takes more time to 
learn to spell the one than the other. It is strange, therefore, 
that no spelling-book has yet appeared based upon a study of 
how frequently children misspell the words of which it is com- 
posed. In fact no study of spelling, that we know of, has done 
more than obtain individual ratings of pupils, based on the tacit 
assumption that the words used are all equally diiBcult to spell. 
No investigation has been thought necessary of the words them- 
selves. The results of this section, although by no means 
thoroughly worked out, sufficiently indicate the present unrelia- 
bility of individual judgment with regard to words, unless the list 
is very short and the judgments very numerous. It is quite 
possible that at some later time, after studies of words based on 
actual tests have been frequently made, our judgment of word 
diflSculties may be greatly improved. Our opinion as to how hard 
words are might then become a valuable supplement to the 
conclusions of the investigator. 

§ 18. Rice Sentence Test. Easy 50-Word Test 

During the middle week of the fall term of 1912, the sentence 
test used by Rice — ^and afterwards by Cornman — was dictated 
to 1984 pupils in schools II, III, and VIII. Children of the 4th 
and 5th grades wrote sentences containing 50 words ; those of the 
6th, 7th, and 8th grades wrote 41 of the same words together with 
36 additional words — 77 in all. The entire test follows : 

Rice Sentence Test 

While running he slipped, I listened to his queer speech, but 
I did not believe any of it. The weather is changeable. His loud 
whistling frightened me. He is always changing his mind. His 



76 Spelling Ability — Its Measurement and Distribution 

chain was loose. She was baking cake. I have a piece of it. Did 
you receive my letter? I heard the laughter in the distance. 
Why did you choose that strange picture? ^Because I thought 
I liked it. It is my purpose to learn. Did you lose your almanac? 
I gave it to my neighbor. *I was writing in my language book. 
Some children are not careful enough. Was it necessary to keep 
me waiting so long? Do not disappoint me so o//^n. I have 
covered the mixture. He is getting better. *A feather is /t^A^ 
Do not deceive me. I am driving a new horse. *Is the surface 
of your desk rou^A or smooth? The children were hopping. 
This is certainly true. I was very grateful for my elegant present. 
If we have patience we will succeed. He met with a severe 
accident. Sometimes children are not sensible. You had no 
business to afww^r him. You are not sweeping properly. Your 
reading shows improvement. The ride was very fatiguing, I am 
very anxious to hear the news. I appreciate your kindness I 
assure you. I cannot imagine a more peculiar character. I 
guarantee the book will meet with your approval. Intelligent 
persons learn by experience. The peach is delicious. I realize 
the importance of the occasion. Every rule has exceptions. He is 
thoroughly conscientious; therefore I do trust him. The elevator 
is ascending. Too much praise is not wholesome. 



TABLE XXX 
Distribution of IxDiviDnAL Ratings. Rice Sentence Test. 



Per Cent Correct 


4th Grade 


5th Grade 


6th Grade 


7th Grade 


8th Grade 


No. 

38 
54 
61 
55 
72 
74 
59 
54 
31 
9 

507 


% 


No. 

3 
13 
18 
49 
62 
76 
76 
91 
65 
17 

470 


% 


No. 

2 
13 
21 
46 
53 
80 
70 
62 
40 

9 

396 


% 


No. 


3 
5 

20 
32 
52 
53 
77 
95 
30 

367 


% 


No. 

I 



2 
15 
37 
61 
96 
33 

244 


% 


0- 10 


7.5 
10.7 
12.0 
10.8 
14.2 
14.6 
11.6 
10.7 
6.1 
1.8 


.6 

2.8 

3.8 

10.4 

13.2 

16.2 

16.2 

19.4 

13.8 

3.6 


.5 

3.3 

5.3 

11.6 

13.4 

20.2 

17.7 

15.7 

10.1 

2.3 




.8 

1.4 

5.4 

8.7 

14.2 

14.4 

21.0 

25.9 

8.2 





11-20 





21- 30 





31- 40 





41-50 


.8 


51-60 


6.1 


61- 70 


15.2 


71-80 


25.0 


81- 90 


39.3 


91-100 


13.5 






Totals 

Medians 


48.17 


64.13 


58.57 


73.86 


82.07 
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The 4th- and Sth-year test ends with " This is certainly true." 
The test for the upper grades comprises all the sentences except 
the four marked with an asterisk. The test words are italicized. 

The principal object in giving this test was to obtain scores 
for a new series of words by which the grade and general scales 
(Figs. 14-20) could be supplemented and extended. The papers, 
however, were also rated for individual performances. Subject 



/O 



O /O ZO 30 ffO ^O CO 70 80 ^O iOO 



20 



/S 



/o 



r 



10 XO 30 HC so 60 70 do 70 /CO 

Fig. 23. Relative frequencies of different percentages correct, 4th grade; 

Rice Sentence Test; Table XXX. 
Fig. 24. Same as Fig. 23, but for 5th grade. 

to the limitations of regarding all words as equal, the results on 
this basis may be used to supplement those of Rice and Comman. 
Rice gives nothing but grade averages, and Comman gives the 
same for two tests after an interval of one year. We shall 
continue to use the median as a measure of central tendency and 
shall give a distribution of pupils' ratings for each grade. Table 
XXX g^ves the distribution by groups of ten with totals and 
medians. Fig. 23 and Fig. 24 show graphically the distribution 
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for the 4th and sth grades. Fig. 8, Fig. 9, and Fig. 10 (page 
33) give the same for 6th, 7th, and Sth grades. 

These medians indicate a performance for these schools poorer 
than Rice indicates for most of his schools and much poorer than 
Comman's results for the two schools which he tested. We can- 
not account for this because neither of these investigators tells 
how he rated the pupils' papers. In our own testing omitted and 
illegible words were counted as wrong. It is probable that the 
manner in which Rice chose his schools would give him those in 
which better than average work was being done ; while Comman's 
two schools were without doubt devoting an unusual amount of 
attention to spelling under his personal guidance. Such being 
the case, it is quite possible that the results here g^ven more 
nearly approach typical conditions, than do those of either of 
these writers. 

TABLE XXXI 

Per Cent Correct for Each Word in Each Grade with Corres- 
ponding P.E. Values. Rice Sentence Test. See Fiq. 25 



No. of 
Word 



1 

2 
3 

4 
5 

6 

7 

8 

9 

10 

11 
12 
13 
14 
15 

16 
17 
18 
19 
20 

21 
22 
23 
24 
25 

26 
27 
28 
29 
30 



Word 



running . . . . 

slipped 

listened . . . . 

queer 

speech 

believe 

weather . . . . 
chAneeable.. 
whistling . . . 
frightened . . 

alwajrs 

changing . . . 

chain 

loose 

baking 

piece 

receive 

laughter 

distance. . . . 
choose 

strange 

picture 

Decaiise . . . . 

thought 

purpose . . . . 

learn 

lose 

almanac 

neighbor. . . . 
writing 



4th Grade 



48.0 
30.0 
29.6 
56.9 
45.3 

37.2 
70.9 
27.7 
27.3 
17.8 

53.8 
58.5 
51.8 
24.7 
63.4 

58.5 
21.1 
59.9 
35.6 
41.7 

57.7 
69.6 
66.2 
58.7 
21.7 

70.6 
46.4 
10.1 
27.5 
56.3 



P.E. 



+ .074 

+ .777 

+ .794 

— .258 
+ .175 

+ .484 

— .816 
+ .878 
+ .895 
+ 1.368 

— .141 

— .318 

— .067 
+ 1.014 

— .508 

— .318 
+ 1.191 

— .372 
+ .547 
+ .311 

— .288 

— .761 

— .620 

— .326 
+ 1.160 

— .803 
+ .134 
+ 1.892 
+ .886 

— .235 



5th Grade 



66.0 
34.8 
40.4 
58.8 
41.4 

49.7 
57.5 
31.3 
40.0 
42.7 

68.8 
69.2 
59.8 
49.1 
75.7 

62.2 
51.7 
71.4 
67.2 
46.3 

74.2 
87.5 
83.9 
72.4 
47.3 

84.9 
53.1 
21.5 
66.6 
74.0 



P.E. 



— .612 
+ .579 
+ .360 

— .330 
+ .322 

+ .011 

— .280 
+ .723 
+ .376 
+ .273 

— .727 

— .744 

— .368 
+ .033 
—1.033 

— .461 

— .063 

— .838 

— .660 
+ .138 

— .963 
—1.706 
—1.459 

— .882 
+ .100 

—1.531 

— .119 
+ 1.170 

— .636 

— .964 



6th Grade 



% 



76.8 

42.9 

53 

77 

72 



64.4 
82.8 
46.7 
49.0 
55.6 

78.5 
74.5 
75.3 
45.2 
83.6 

69.9 
59.8 
75.5 
75.8 
56.8 

86.9 
94.4 



66.9 

93.2 
56.8 
38.6 
65.2 



P.E. 



—1.086 
+ .265 

— .130 
—1.110 

— .864 

— .547 
—1.403 
+ .123 
+ .037 

— .209 

—1.170 

— .974 
—1.014 
+ .179 
—1.450 

- .773 

- .368 
-1.024 
-1.038 

- .254 

-1.663 
-2.367 



— .648 

—2.211 

— .254 
+ .430 

— .579 



7th Grade 



or 



85.0 
51.8 
69.8 
79.0 
77.1 

62.1 
88.0 
66.8 
68.7 
71.4 

88.6 
89.6 
88.0 
63.2 
93.5 

83.7 
62.1 
88.8 
88.0 
83.1 

93.5 
97.5 



74.7 

95.9 
60.0 
58.6 
86.0 



P.E. 



-1.537 

- .067 

- .769 
-1.196 
-1 . 101 

- .457 
-1.742 

- .604 

- .723 

- .838 

-1.788 
-1.867 
-1.742 

- .500 
-2.245 

-1.456 

- .457 
-1.803 
-1.742 
-1.421 

-2.245 
-2.905 



- .986 

-2.579 

- .876 

- .322 
-1.637 



Sth Grade 



P.E. 



93.4 
70.9 
86.9 
87.3 
80.7 

76.6 
92.2 
65.6 
74.2 

85.7 

95.5 
91.4 
95.9 
81.6 
97.5 

90.6 
80.7 
96.3 
97.5 
85.7 

92.6 
98.8 



92.6 

99.6 
55.7 
72.1 
93.4 



-2.234 

- .816 
-1.663 
-1.692 
-1.286 

-1.076 
-2.103 

- .596 

- .963 
-1.582 

-2.514 
-2.035 
-2.579 
-1.335 
-2.905 

-1.953 
-1.286 
-2.648 
-2.905 
-1.682 

—2.145 
—3.846 



—2.145 

—3.938 

— .213 

— .869 
—2.234 
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TABLE XXXI 

{Continued) 



No. of 
Word 



31 
32 
33 
34 
85 

36 
37 
38 
39 
40 

41 
42 
43 
44 
45 

46 
47 
48 
40 
50 

51 
52 
53 
54 
55 

56 
57 
58 
50 
60 

61 
62 
63 
64 
65 

66 
67 
68 
69 
70 

71 
72 
73 
74 
75 

76 
77 
78 
79 
80 

81 
82 
83 
84 
85 
86 



Word 



4th Grade 



language, 
careful . . . 
enough... 
neceraary. 
waiting. . . 

disappoint 

often 

covered . . 
mixture . ■ 
getting. . . 

better. . . . 
feather. . . 

Ught 

deceive. . . 
driving.. . 

surface. . . 
rough .... 
bmooth . . . 
hopping. . 
certainly . 

grateful .... 

elegant 

present 

patience. . ■ . 
succeed .... 

severe 

accident.. . . 
sometimes. ■ 
sensible .... 
business. . . . 

answer 

sweeping . . . 

properly 

improvement 
fatiguing . . . 

anxious .... 
appreciate. . 

assure 

imagine .... 
peculiar .... 

character. . . 
guarantee... 
approval . . . 
intelligent . . 
experience. . 

delicious 

realise 

importance . 
occasion.. . . 
exceptions. . 

thoroughly. . 
conscientious 
therefore . . 
ascending.. 

praise 

wholesome. 



40.3 
54.3 
54.9 
4.5 
55.9 

11.7 
51.6 
42.1 
33.6 
57.5 

80.6 
77.1 
77.5 
18.4 
69.7 

48.4 
64.2 
47.2 
58.1 
16.8 



P.E. 



+ .364 

— .160 

— .183 
+ 2.514 

— .220 

+ 1.757 

— .059 
+ .296 
+ .628 

— .280 

—1.279 
—1.101 
—1.120 
+ 1.335 

— .364 

+ .059 

— .539 
+ .104 

— .303 
+ 1.427 



5th Grade 



62.8 
58.6 
68.0 
21.5 
66.8 



27. 

67. 

62.6 

62.6 

74. 



91.8 
84.1 
90.5 
46.3 
77.1 

79.1 
69.8 
51.3 
58.1 
36.0 



P.E. 



— .484 

— .322 

— .693 
+ 1.170 

— .604 

- .891 

- .280 

- .476 

- .476 

- .972 

—2.064 
—1.481 
—1.944 
+ .138 
—1.101 

—1.201 

— .769 

— .048 

— .303 
+ .531 



6th Grade 



% 



68.9 
80.3 
42.7 
82.3 

34.6 
75.8 
77.5 
83.3 
87.4 

94.9 



53.5 
88.1 



68.4 
57.1 

39.1 
53.5 
69.7 
43.4 
53.0 

40.9 
45.5 
52.5 
34.3 
46.0 



74. 

87. 

61. 

59.6 

12.6 



P.E. 



— .731 
—1.264 
+ .273 
—1.374 

+ .588 
—1.038 
—1.120 
—1.432 
—1.699 

—2.425 



- .130 
-1.749 



7th Grade 



85.8 
91.0 
37.6 
89.9 

32.4 
87.2 
90.2 
91.0 
94.6 

98. 6 



54.8 
65.7 



49.0 
31.8 
58.1 
33.6 
24.0 

40.2 
11.6 
38.1 
37.1 
44.4 

31.3 
53.5 
47.5 
34.8 
48.2 

18.7 
.3 
36.4 
37.6 
69.0 
56.3 



— .710 

— .265 

+ .410 

— .130 

— .766 
+ .246 

— .112 

+ .341 

+ .168 

— .093 
+ .600 
+ .149 

— .954 
—1.699 

— .418 

— .360 
+ 1.699 

+ .037 
+ .702 

— .303 
+ .628 
+ 1.047 

+ .368 
+ 1 . 772 
+ .449 
+ .448 
+ .209 

+ .723 

— .130 
+ .093 
+ .579 
+ .067 

+ 1.318 
+4.167 
+ .516 
+ .468 

— .735 

— .235 



P.E. 



81.2 
79.0 

58.6 
65.7 
79.0 
63.0 
70.8 

61.3 
68.9 
67.3 
55.0 
53.7 

86.9 
92.1 
73.0 
69.5 
25.3 

66.2 
49.0 
68.9 
47.7 
46.3 

47.1 
19.9 
56.9 
43.6 
63.5 



—1.589 
—1.988 
+ .468 
—1.892 

+ .657 
—1.685 
-1.918 
—1.988 
—2.384 

—3.258 



— .179 
—2.177 



-1.313 
-1.196 

- .322 

- .600 
-1.196 

- .492 

- .812 

- .426 

- .731 

- .665 

- .187 

- .138 



8th Grade 



P.E. 



88.1 
98.4 
61.5 
92.2 

38.9 
92.2 
97.1 
97.1 
97.5 

100.0 



79.5 
98.8 



89.3 
91.0 

61.9 
69.3 
91.4 
80.7 
80.7 

70.9 
85.2 
82.8 
65.2 
68.4 



—1.663 93.4 



61. 

65. 

73. 

44 

57 



31.1 
1.6 
62.4 
52.0 
78.2 
74.7 



—2.093 

— .909 

— .756 
+ .986 

— .620 
+ .037 

— .731 
+ .085 
+ .138 

+ .108 
+ 1.253 
—1.258 
+ .239 

— .512 

— .437 

— .600 

— .922 
+ .209 

— .269 

+ .731 
+3.171 

— .468 

— .074 
—1.155 

— .986 



94.7 
86.5 
86.5 
31.1 

84.0 
74.6 
86.1 
66.4 
56.1 

78.7 
25.8 
75.4 
50.4 
68.9 

85.2 
73.4 
81.6 
49.6 
76.2 

53.3 
19.7 
79.9 
55.7 
95.9 
86.1 



—1.749 
—3.182 
— .434 
—2.108 

+ .418 
—2.103 
—2.811 
—2.811 
—2.905 



-1.222 
-3.346 



—1.843 
—1.988 

— .449 

— .748 
—2.035 
—1.286 
—1.286 

— . 816 
—1.549 
—1.403 

— .579 

— .710 

—2.234 
—2.397 
—1.636 
—1.636 
+ .731 

—1.475 

— .982 
—1.609 

— .628 

— .228 

—1.181 
+ .963 
—1.019 

— .015 

— .731 

—1.549 

— .927 
—1.336 
+ .015 
—1.057 

— .128 
+ 1.264 
—1.243 

— .213 
—2.579 
—1.609 
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With respect to the ratings of words, Table XXXI gives fo: 
each grade the per cent of correct spellings and the P.E. value 
calculated from the grade medians, assuming a normal distribu 
tion. Fig. 25 (insert) shows the lines the same words arranges 
on a linear scale for grades 4, 5, 6, 7, and 8. Above the line 
the arrangement of the words of the Preferred List is given. Thi 
latter is a repetition of the scales of Figures 15, 16, 17, 18 an< 
19 (p. 44). It will at once be seen that the former scaler 
obtained by using the Preferred List, have been filled in and hav« 
been extended much further to the right. 

Just as the more difficult words of the Rice Test may be usee 
to extend the scales to the right, so the easier words of the Eas] 
50- Word Test may be used to extend it towards the left in certaii 
grades. In the grades of the second school year the latter wen 
the only words used. Although the primary object in giving th< 
Easy 50- Word Test was to enable us to give a position to thi 
zero-point, and although for this purpose the ratings of individua 
pupils were sufficient, nevertheless the per cent of correct spelling 
for each word in each grade (2a, 2b, 3d, and 4th) was als< 
calculated. 

Table XXXII gives these per cents and the corresponding P.E 
values. It will be noted that there are six words {even, only 
pretty, sure, touch, and front) that are common to this list an< 
to the Preferred List. 

TABLE XXXII 



Per Cent Correct 

PONDING 


FOR Each Word in Each Grade with Corrbs- 
P.E. Values. East 60-word Test 


No. 

of 

Word 


Word 


2a Grade 
175 Pupils 


26 Grade 
160 Pupils 


3d Grade 
168 Pupils 


4th Grade 
316 PupilB 


% 


P.E. 


% 


P.E. 


% 


P.E. 


% 


P.E. 


1 

2 
3 
4 
5 

6 
7 
8 
9 
10 


you 

will 

hear 

him 

coming . . 

he 

is 

on 

the 

road .... 


62.6 
46.9 
37.1 
25.7 
9.7 

62.3 
65.7 
57.7 
65.7 
4.6 


— .097 
+ .119 
+ .489 
+ .968 
+ 1.926 

— .464 
— - .600 

— .288 

— .600 
+2.498 


71.6 
83.4 
53.3 
71.6 
33.7 

88.7 
94.7 
88.7 
94.7 
20.7 


— .847 
—1.438 

— .123 

— .847 
+ .624 

— 1 . 796 
—2.397 
— 1 . 796 
—2.397 
+ 1.211 


83.9 
96.4 
60.1 
81.0 
67.1 

98.2 
96.4 
94.6 
94.6 
53.6 


—1 . 469 
—2.667 

— .380 
1.302 

— .265 

—3.111 
—2.667 
—2.384 
—2.384 

— .134 


93.4 
99.1 
79.4 
97.5 
83.6 

99.7 
98.4 
97.8 
97.8 
82.6 


—2.23 
^3.60 
—1.21 
—2.90 
—1.44 

—4.08 
—3.18 
—2.98 
—2.98 
—1.39 
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Figures 26, 27, and 28 give the scales for these words. In 
Figure 27 it is indicated below the line with the omission of the 
six words noted in the last paragraph. Above the line the 
words of the Preferred List are reproduced from Figure 14. 
Since the Easy 50- Word Test was also given to 4th-grade chil- 
dren it is likewise scaled for that grade omitting the same six 
words. (Fig. 25, 4th grade, lower line.) 

We have, therefore, scales for every grade from the first half 
of the second grade to and including the eighth. All of these 
scales above the 2d grade are much richer than were those 
given in Section 12. There are fewer gaps in them and their 
range is greater. They may be used to great advantage in 
testing the spelling ability of children in any grade of the 
elementary school in which children are supposed to have any 
such ability. If it is not convenient to use a whole scale, certain 
words differing in difficulty by approximately equal amounts 
may be selected. Groups of words may be made each of equal 
difficulty as a group, or each differing from the preceding group 
by a fixed amount. The position of each word shows the weight 
which ought to be assigned to it for test purposes. 

Each of these grade scales refers to the median of the grade 
as the zero-point. In Figure 29 is shown a scale for all grades 
referring, as in Figure 20, to the median of the 3d grade as the 
zero-point. Above the line is shown the Preferred List as in 
Fig 20. Below it are arranged the words of Rice's Test; and 
on a parallel scale the Easy 50- Word List. Caution, however, 
ought to be observed in accepting too literally the showing of 
the last two lists. Rice's Test was not g^ven to the 3d grade, 
and the Easy 50- Word Test was g^ven to the 2d grade and 
was not given above the 4th. They cannot, therefore, be closely 
compared with the Preferred List. The effect of high grades 
is to make the words harder, of low grades to make them easier. 
In the case of the Rice Test the words are probably a little — 
but only a little — too far to the right, — i.e., farther toward the 
high end than they would have been had they been used in the 
3d grade — as Comman used them. In the case of the Easy 
50- Word Test the words would be a great deal too far to the 
left if set down as the record indicated. The six words common 
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to this list and to the Preferred List enable us to suggest a 
correction. Their P.E. values, when the averages of the grades 
writing them are taken, appear as follows : 

Easv 50- Preferred 

worcl list List Increase 

sure +.530 +1.57 1.04 

front —.299 +1.06 1.36 

touch +.652 +1.71 1.06 

only —.089 — .57 .66 

pretty —.024 +1.31 1.33 

even —.097 + .70 .80 

Average Increase 1 . 04 

It appears, therefore, that in order to compare the words of 
the Easy so-Word List with those of the Preferred List and 
to scale them together we ought to raise all the words of the 
former list about i P.E. In Figure 29, accordingly, all these 
words have been raised that amount. 

Fig. 29 shows our most complete scale. It has decided limita- 
tions, and it is impossible — in the case of the newly added 
words — to suppose that it is more than an approximation. A 
great deal more testing than we have been able to do will have 
to be done before these words and others with them can be 
precisely fixed beyond dispute. It is not claimed that the scale 
we give is final. We think, however, that, supposing the two 
fundamental assumptions upon which it is based to be valid, 
it may be used in its present form with substantially accurate 
results ; and we are confident that the general method by which 
it has been derived is the one by which a final scale may ulti- 
mately be secured. 

The top figures in Fig. 29 refer to the absolute zero-point, 
taken as 470 below the 3d-grade median. It enables us to state 
not only the difference in difficulty between words but their 
relationships. We may say, for instance, that school (No. 27 
E. So-W. L., scales at 428) is one-half as hard as grateful 
(No. 51 R. S. T., scales at 856). We may put certain facts in 
equation form as follows: 

in = y2 light =:y^ pigeons = % fatiguing 
is = ^ also = J^ occasion = %. conscientious 
the=^]/i chicken ^^Yz approval 
and = y2 penny = yi peculiar 
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Many more such statements may be made. It will, we think, 
surprise most people to learn that fatiguing is only four times 
as hard as he, or that to spell occasion shows but three times as 
much ability as to spell is. 

In fact it will, we think, be seriously questioned whether such 
words as at, of, on, do, etc., have difficulties anything like as 
great as is shown on our scale. It will be asked. What words 
can be easier than these? If a child cannot spell them does he 
not show zero ability? The answer is that if one or more of 
these very easy words were isolated and pronounced to a group 
to be written, those who could not spell them would indeed 
show no spelling ability. But these words were not isolated, 
they were given in a context. It is one thing for children to 
write the word *' at " when pronounced alone or in column 
dictation. It is quite another to write it in the sentence : " They 
are not at all pretty." Some will omit it, and this fault is not 
confined by any means to the lowest classes. Some will connect 
it with the word all, because they habitually do so in speaking. 
Some little children will quite break down on the whole sentence 
because they can't get over the word " they." In other sentences 
some will substitute a word (generally of similar meaning) for 
the one dictated. Each of these faults scores " wrong," and 
none of them would be made in column dictation. It is also true 
that children writing sentences more often write illegibly than 
they do when writing a few words in columns; and this is 
particularly true with young children. 

It will therefore be clear that the decision as to how hard a 
word is, depends on how you use it in testing and when you call 
it " wrong." To verify the placings of the words given in this 
study one ought to use the same test material and the same 
method of scoring. In particular, column dictation will not do 
at all. 

§ 19. Derived Forms of Distribution 

The foregoing treatment of the measurement of spelling 
ability has, as has been indicated frequently, proceeded upon 
the assumption that the distribution of ability is in all grades 
normal. Such an assumption has always been made in the 
investigation of school abilities by persons whose knowledge of 
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the theory of statistics has enabled them to do so. In Section 10 
I have said : " There seems no good ground for assuming that 
the distribution of spelling ability in any grade is not according 
to the normal curve or according to a curve which resembles it 
closely." By this alternative is suggested the possible applica- 
bility of certain curves not of normal form but resembling the 
normal form. Our problem will now be to derive and apply 
to some of our material such modifications of the type form of 
distribution as our present knowledge of grade conditions 
permits. 

In order that the frequency of measurements within a group 
may be distributed according to the Probability Integral it is 
necessary that the group be in no way selected on the basis of 
the characteristic that is measured. It must be a random 
sampling from a " total population." If the frequency distribu- 
tions of statures for adult males bom in the City of New York 
may be expected to japproximate the symmetrical type, the 
distributions of statures for adult males on the police force of 
New York City would not do so. Their curve will be of the 
"moderately asymmetrical type'* being cut off at the low end 
because extremely short men are at a disadvantage in the group 
supposed to be measured. In other words, there is a selection 
on the basis of stature. The group " adult males on the police 
force of New York City " is not a random sampling of the total 
population " adult males of New York City." 

The question then is: To what extent does the membership 
of each grade of the elementary school fail of being a chance 
selection from a total population ? We may fairly assume, in the 
first place, that the pupils of the first and second grades are 
unselected. Practically all children attend school and none drop 
out in these grades. From the 3d grade on, however, each 
successive grade constitutes a group which is less and less a 
random sampling. Many influences are at work to eliminate 
a greater and greater number of individuals. Probably the most 
important of them is the inability of children to progress — i.e., 
lack of ability in the lines of work now required by the schools. 

The extent to which elimination takes place in the grades has 
been the subject of study by a number of investigators. The 
first of these was Thomdike ('07). He draws conclusions from 
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conditions in 23 cities as they were about 1900. He estimates 
that out of 100 entering pupils, 97 remain till grade 3, 90 till 
grade 4, 81 till grade 5, 68 till grade 6, 54 till grade 7, and 40 
till the last grammar grade (8th or 9th). Ayres ('09) sharply 
criticised these figures, stating that they were too small. He 
contended, particularly, that there was no dropping out before 
the 6th year — a conclusion which common observation and later 
investigation unite to disprove. Emplo)mient certificates are 
granted in great nimibers to 5th-grade children. Mr. Ayres' 
%ures for retention are as follows: Grades 1-5, 100 (i.e., no 
elimination) ; grade 6, 90; grade 7, 71 ; grade 8, 51. 

Thomdike, using later and better reports, subsequently derived 
figures a little higher than his former ones, but substantially 
in agreement with them (Thomdike, '10). They were no higher 
probably than S or 6 years of agitation would have led one to 
expect. 

Another important study of this question was made by 
Strayer ('11), the material being used from 318 cities. His 
conclusions tend to group with Thomdike's rather than with 
those of Ayres. Owing to the large number of cities whose 
returns were used, the uniform method of taking the census, 
and the recency of the conditions studied, this investigation is 
highly important. No single figures are given for retention in 
general, though they are easily found. Using the largest age 
group as the number of entering children, he gives the following 
as *the median per cents in each grade. 
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Since in this study we group boys and girls together and consider 
general conditions, the average of these percentages will give 
figures for retention for each grade (subject to deduction for 
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repeaters) as follows: 3d grade, no; 4th grade, 106; 5th grade, 
96; 6th grade, 84; 7th grade, 70; 8th grade, 55. If, as Dr. 
Strayer says, a fair estimate of the number of repeaters in the 
6th, 7th, and 8th grades would be 12%, 10%, and 8% of the 
pupils in each grade (p. 136), it is likely that the progression 
(8, 10, 12) may be carried back to the 5th, 4th and 3d grades 
without great violence to the facts. We estimate therefore that 
the number of repeaters in the 3d, 4th, and 5th grades is 18%, 
16%, and 14% of the pupils in each grade. Making these de- 
ductions from the above percentages, we have for the retention : 
3d grade, 92; 4th grade, 90; 5th grade, 82; 6th grade, 72; 7th 
grade, 60; 8th grade, 47. 

Weighing as best we can the results of these four studies, 
we have made the best estimate we can for the probable amount 
of retention at present in the grades. For reasons that will 
appear later we have expressed this estimate in numbers per 
10,000 instead of per 100. 

Table XXXIII and Fig. 30 show the percentages we have 
adopted compared with those of Thomdike, Ayres, and Strayer 
(as derived). Fig. 30 gives only the earlier of Thomdike's 
percentages. 

TABLE XXXIII 
Percentages of Retention. Grades 3 to 8 





3d 


4th 


5th 


6th 


7th 


8th 


Thomdike '07 


97 
100 

92 
97.26 


90 

100 

91 

90 

95.46 


81 
100 
81.5 
82 

88.40 


68 
90 
70.9 
72 

70.87 


54 
71 
56 
60 

57.44 


40 


Ayres '09 


51 


Thomdike '10 


41.2 


Strayer '11 (derived) .... 
AdoDted 


47 
48.21 







Such an amount of retention for each grade having been 
adopted, the next question to consider is: What part of a 
normal distribution is thus eliminated? Obviously not all the 
poorest in ability drop out. Our results for spelling show that 
some very poor spellers are retained even in the highest grades. 
Yet the greatest elimination will no doubt be among those of 
lowest ability and will be progressively less among children of 
greater ability. How much this amounts to for successive incre- 
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ments of ability we do not positively know. We are again forced 
to make as reasonable an estimate as we can, and this time 
without the help of any investigations. 
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Fig. 30. The horizontal scale is for the grades of the elementary school ; 
the vertical scale is for percentage of pupils retained. 

We have estimated (Table XXXIII) that 9725 out of 10,000 en- 
tering children are retained in the 3d grade; and we judge further 
that all below — 4 P.E. have dropped out, that at — 3 P.E. 40% 
have drppped out, and that at — 2 P.E. none at all. In the 4th 
grade, retention is put at 9546 in 10,000 (Table XXXIII) and 
total elimination is estimated to operate up to — 3.7 P.E. From this 
point to — 2,7 P.E. the force of elimination is supposed gradually 
to diminish until 40% drop out. At — 1.7 P.E. only 10% are 
estimated as lost to the grade. At — 1.2 P.E. the forces tending 
to eliminate children are supposed to have been completely 
counteracted by the opposing forces tending to retain them. In 
the 5th grade (8840 out of 10,000 retained) the elimination is 
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assumed to be total up to — 3.2 P.E. and partial as high as 
— 0.2 P.E. In the 6th grade (7087 out of 10,000 retained) the 
corresponding points are — 2.7 P.E. and + 3.3 P.E. ; in the 7th 
(5744 retained) they are — 2.3 P.E. and + 3.7 P.E. ; and in the 
8th (4821 retained), — 2 P.E. and + 6 P.E. It is, therefore, sup- 
posed that in the last three years of the elementary school there 
is some elimination even among the most capable children. This 
plan of elimination and retention may easily be attacked as 
artificial and it may very likely be shown to need considerable 
modification when later and better knowledge is available on this 
difficult subject. Meanwhile, however, some assumption was 
necessary in order to construct any sort of frequency tables 
which should illustrate the method of constructing a scale when 
account is taken of the selective influence of the grades. We can 
only state that we have keenly appreciated the importance of 
distributing the amount of elimination where it most probably 
occurs, that we have been at no small pains to find out where 
to distribute it, and that we have estimated as wisely as we could. 
Table XXXIV gives the entire plan of elimination and retention 

for each grade. 

^ TABLE XXXIV 

Plan of Elimination and Retention for Each Grade 



Grade, ete. 


(X 
P.E. 
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, cent 
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3d Grade. 
i\r=0725. 
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—2 


100 

40 






60 
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7th Grade 
i\r=5744. 
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i\r=9546. 
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iV=4821. 
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5th Grade 
i\r=8840. 


—3.2 
—2.2 
—1.2 
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50 
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80 
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6th Grade 
iV— 7087 . 
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15 
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Figs. 31-36. The estimated amount and distribution of elimination and 

retention. See Table XXXIII. 
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The next step was to apply the data of Table XXXIV to the 
normal distribution and to derive therefrom for each grade a 
modified distribution which should take account of the amount 
and range of elimination as estimated. In order that the validity 
of our method may be open to inspection, we shall illustrate for 
the 6th grade the manner in which these modified distributions 
were derived. 

We have adopted certain percentages of retention for desig- 
nated amounts of general ability (Table XXXIV, 6th grade), 
and these percentages must not only stand the test of reasonable- 
ness in themselves, but they must also when applied to a normal 
table of frequency (the sum of whose cases is, say, 1000), reduce 
the ntmiber of cases to an amount which represents a reasonable 
percentage of retention for the 6th grade (say, 70 or 71). That 
is, the derived table must show approximately 700 cases out of 
1000, or 7000 out of 10,000. We shall see later to what extent 
this turns out to be true. 

Adapting the normal table of frequency (Table XIV, page 35) 
so as to include 1000 cases instead of 10,000 and taking intervals 
of o.i P.E., we have columns i and 2 of Table XXXV. In 
column 3 we increase the percentages of retention from o at 

— 2.7 P.E. to 40 at — 1.7 P.E. by increments of 4 for each of the 
ten steps; then by increments of 2.5 until 65 is reached at 

— 0.7 P.E. ; then by increments of 2 to 85 at + 0.3 P.E. ; and 
so on as required by Table XXXIV, col. 4. Taking these 
percentages of the frequencies in column 2 gives the derived 
frequencies of column 4. The sum of the entries in this coltmm 
being 708.7, the plan gives an amount of elimination which is 
reasonable for the 6th grade. (See Table XXXIII.) 

The amount and distribution of elimination and retention are 
shown by diagram for each grade in Figs. 31 to 36. Fig. 34 
in particular shows these facts for the 6th grade, and is the 
graphic representation of the series of frequencies in column 4 
of Table XXXV. Fig. 31 shows the same facts for the 3d 
grade, Fig. 32 for the 4th grade, etc. The progressive increase 
in elimination and the extension of it to higher and higher parts 
of the normal curve are the facts to be noticed. 

But we have not in column 4 of Table XXXV, a frequency 
table for the 6th grade in the most useful form. The area of its 
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TABLE XXXV 

Sixth Grade. Derivation of Modified Table of Frequbnct 
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curve is no longer 1000, but only 708.7. In order to express the 
several frequencies in the form of per cents, we shall have to 
divide each of them (column 4) by their total (708.7). Express- 
ing these quotients on the basis of 10,000 instead of 1000, we have 
column 5. These are the numbers in the columns 3 and 5 of 
Table XXXIX (p. 96) ; and when their sums are taken begin- 
ning at o they constitute the Modified Table of Frequency for 
the 6th grade (Table XXXIX). 

TABLE XXXVI 
HoDiriED Table of FaiauBNcr, 3d Gbadk. Uedian ^+0.051 P,E. 
Plan of elimination: —4 P.E., 100%; —3 P.E., 40%; —2 P.E., 0%. 
Total area of the Burface of frequency taken as 10,000. See Fig. 37. 
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TABLE XXXVIII 

HoDmxD Tablb or FBiQuiiNcr, 5th Gradb. Hbduh^+OJIS P.E. 

Plan of dimination: —3.2 P.E., 100%; —2.2 P.E., 60%; —1.2 P. E., 
20%; — 0J2 P.E., 0%. Total ana of lh« aurface of frequenoy tak«a a« 
10,000. See Fig. 39. 
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TABLE XXXIX 

HoDinsD Tablb of Fbcquutct, 6th Gauw. Hcdum =+0.418P£. 

PUn oi eUmiMUon: —2.7 P.E., 100%; —1.7 P.E., 60%; —0.7 P.E., 
35%; +03 P.E., 15%; +1.3 P.E., 10%; +2.3 PJl.. 8%; +3.3 P£., 
0%. Total area <rf surface of frequencr takeo aa 10,000. See Rg. 40. 
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TABLE XL 

HoDiniii Table of FaBQuxtrcr, 7th Ghadb. HbdijUc+0.669 P.E. 

Plan of elimination: —2.3 P.E., 100%; —1.3 P.E., 70%; —0^ P.B., 
B0%; +0.7 P.E., 20%; +1.7 P.E., 10%; +2.7 P.E., 6%; +3.7 P^., 
)%. Total area of frequenc; aurface taken as 10,000. See Fig. 41. 
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TABLE XLI 

MODiFnii Table of FugnxMcr, &ra Gbadb. Mbi>i4»= +0,746 P.E. 

PlanotelimiMtion: — 2 P.E., 100%; — 1 P.E., 70%; P.E., 60%; +1 
P.E.,30%; +2P.E., 20%; +3P.E., 10%; +4 P.E., 6%; +6P.E., 2%; 
+6P.E., (>%. Total area of frequency surface taken M 10,000. See Fig. 42. 
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In this manner each of the Modified Tables of Frequency was 
made up. They are given in tables XXXVI to XLI. Th^ 
are intended to take the place, each for the grade to which it 
applies, of the Table of Frequency for the normal distribution. 
Since they are asymmetrical, the lower and upper parts have to 
be given separately. For the same reason there is no P.E., the 
use of the Probable Error as a unit of amount being properly 
confined to normal curves only (Yule, 'ii, p. 147). The 
quartile deviation (Q3 — Qi) might be used instead, but its 
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Figs. 37-42. Derived Forms of Distribution. Grades 3 to 8. 
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value differs for each of the six tables. In order therefore to 
employ a unit which should be the same for all, including the 
normal distribution, we have retained the P.E. of the Proba- 
bility Int^^al. It is now no longer a function of the modified dis- 
tributions, but a mere unit of length. Likewise in order to 
have a common point of reference the median of the normal 
distribution has been retained, the terms " low " and " high " in 
the tables referring to parts below or above that point. The 
real median of each modified distribution, however, is given, 
being expressed as a deviation from the old median. 

Figs. 37 to 42 are to be considered in connection with tables 
XXXVI to XLI, of which they are the gfraphic expressions (the 
curves being " smoothed," to represent an indefinite number of 
cases) . They are also to be considered in connection with Figs. 31 
to 36, from the " retention " parts of which they are derived 
by making the areas 10,000. In Figs. 37 to 42, the curve extend- 
ing farther to the left is in each case the normal curve and 
OM is its median vertical. O^M^ is the median vertical of the 
modified surface and 00^ is the distance between medians. The 
values of these are as follows: 3d grade, 0.051 P.E.; 4th 
grade, 0.087 P.E.; 5th grade, 0.215 P.E. ; 6th grade, 0.418 P.E.; 
7th grade, 0.669 P-E. ; 8th grade, 0.746 P.E. 

Is it worth while to use these tables instead of the normal 
one? Will the same material when analyzed by the skew and 
normal distributions yield differences that are important? With 
the purpose of throwing some light on this question we have 
used the modified tables to interpret the results of testing with our 
Preferred List, and the rest of the present section will be 
devoted to this matter. The differences will not in many cases 
be found to be large. This is, of course, particularly true when 
the early grades are concerned, the curves being for those grades 
almost normal. It may be remarked, however, that the applica- 
bility of these tables does not rest upon the results here shown. 
It is general ability rather than spelling ability that tends 
strongly to keep children in school. Spelling ability does not 
correlate as highly with general ability as do the abilities 
in most other school subjects. It is quite likely, therefore, that 
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the use of these tables for the statistical treatment of other 
subjects may be more satisfactory than it is for spelling. They 
are given here primarily to illustrate the method. 

TABLE XLII 

Number and Per Cent of Ttjtilb in Each Grade Whose Abujtt 
Equalled or Exceeded that of the Median Pupil in Evert Other Grade 
WITH the P.E. Values Corresponding to Each Per Cent. Selected 
List. Modified Distributions. Compare with Table XV (p. 36) 
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In Section ii we located the grade medians assuming normal 
distribution. In Tables XLII and XLIII the same data have 
been subjected to analysis using the modified distributions. 
These tables are to be compared with Tables XV (page 36) and 
XVI (page 39). The median intervals are considerably less 
than thqr were found to be by using the normal distribution. 
Note the comparisons in Table XLIV (page 103). 

On the average, the intervals by the present method are less 
than the same intervals found by using the normal distribution 
by 0.1247 P.E., or about half a step in the lo-point scale (Table 
XX, page 52). Since this occurs five times the entire range 
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TABLE XLni 
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from Af, to Jfg is contracted by 0.7235 P.E., an amount which 
is more than some grade intervals {M^ by normal dis., M^ 
and M^^ by modified dis.). This is an important difference. 
In the matter of scaling the words, there is, as might be 
supposed, very little difference for the 3d gjade — so little as 
to be quite negligible. For the 4th grade there is some difference, 
and for each successive higher gfrade the difference between 
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the placings of the same word by the two methods becomes 
greater and greater as the as)rmmetry of the modified curves 
becomes more and more pronounced. 



TABLE XLIV 

Comparison of Ateraqks of Median Distances bt Normal Distribu- 
tion AND BT Modified Distributions 

Normal Distribution Modified Distributions 
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Table XLV compares the deviations from gfrade medians of 
the words of the Preferred List by Normal Distribution and 
by Modified Distributions. Figs. 43 to 47 give the same facts 
in graphic form. Words spelled by 50 per cent of pupils are 
of course always at o. Words spelled by more than 50 per cent 
of pupils do not deviate from the median as much by modified 
as by normal distribution. The same is true of those spelled by 
less than 50 per cent of pupils. The easier a word is and the 
harder a word is, the greater, accordingly, is the difference in 
placing. The effect therefore of the modified distributions is to 
shorten the range of the grade scales. In using the scales, 
especially for pupils of the higher grades, all differences in 
ability between individuals or gfroups would tend to be decreased. 
It seems likely that these differences are in reality more nearly 
what the modified distributions show them to be. The wide 
range of the normal curve especially when its spread is assumed 
to be the same for all grades would seem to extend too far, 
particularly towards the low end. On the other hand, it should 
be said that for the words used in our scale the normal distribu- 
tion gives results that are, practically speaking, satisfactory for 
grade scales. 
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relatively low ratings in the lower grades would take a position 
above the other whose ratings were relatively high in the lower 
grades. This is because the modified distributions in the upper 
grades are such that counting in from the high end more rapidly 
approaches the median than does counting in the same per cent 
of the area of the normal curve. Take for example the words 
25 nor and 45 answer. Compare the per cent ratings in Table 
XLV. Nor is easy in low grades and hard in upper grades, 
relative to answer. With the same normal distribution for all 
grades nor is a little harder than answer. By the modified dis- 
tributions it is easier. Other words may easily be selected in 
Fig. 48 which show differences in arrangement. It is therefore 
true that the use of modified forms of distribution makes a 
difference which is worth noting in the scaling of words. A 
question to be decided on the evidence of more complete testing 
and a wide use of these forms of distribution is whether the 
differences here shown to exist impair the usefulness of the 
scales we have previously derived. Our judgment at present 
is that they do not. 

§ 20. Conclusiofts 

We have now certain data in hand and we may make a few 
general statements . from them. 

We have selected from a school list of about 5000 words a 
list for test purposes in grades 3-8 which, when put in sentences, 
yielded a list of 270 words. As a result of testing in two schools 
a selected list of 100 words was chosen and to it were added, 
at a later time, 18 more. These were dictated at three schools 
and the 100 words alone subsequently at two more schools. 
From the 118 were chosen two lists of 25 each. The three 
successive selections were made with the purpose of securing 
words which were easy enough in the 3d grade and hard enough 
in the 8th grade to afford a test in those and therefore in intei- 
mediate grades, and which showed regular increases in per cent 
correct from grade to grade. The two 25-word lists were then 
subjected to analysis and found to have high correlations 
between grades and between schools. 

Using the entire test material and the ratings of individual 
pupils and assuming normal distribution and equal variability. 
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the differences between typical grade abilities were found and 
expressed as median intervals. 

The 50 words which had been derived by a threefold selective 
process and subjected to close inspection for permanency as 
between grades and schools were scaled for each grade and for 
all grades combined. By using an " Easy 50-Word List " an 
expression was derived for the zero-point ; and, by further test- 
ing tmder rigidly controlled conditions^ previous grade-intervals 
were verified. 

To fill in and extend the scale, the Rice Sentence Test was 
dictated and the word-scores for the Easy 50- Word List were 
used. It is to be understood, however, that neither of these lists 
was subjected to the scrutiny that was made of the Preferred 
List. Accordingly we cannot regard the placing of these words 
as very reliable. 

Finally we have derived and applied tables of frequency 
more or less asymmetrical in character according to the amount 
of retention for each grade and its estimated distribution. By 
using them, results have been obtained which in some instances 
differ considerably from those obtained on the basis of a normal 
distribution. Such differences as appear are, we are convinced, 
differences in the direction of a truer representation of the facts. 
On the whole, however, the differences are not sufficient to 
impair our previous results for any practical use which is likely 
to be made of them. 

It has become evident to us that there is a lack of knowledge 
of the spelling problem not only among teachefs but also among 
those who direct their work. This is unfortunate, considering 
the relative definiteness of the subject and the comparative ease 
with which results in it may be scored. Nor is there any special 
consciousness of the need of more insight in this matter. Almost, 
if not quite, all the studies that have hitherto been made have 
dealt with individual performances. The behavior of words has 
received no attention. ,_^^_,^ 

It is our belief, however, that a powerful improvement in the I 
teaching of spelling may be derived from a more critical knowl- ' 
edge and more accurate judgment on the part of teachers and 
supervisors of the material of the subject — i.e., of the words of 
the language. If in a list of 50 words the one word that is 
incontestably hardest is by more than one-fourth of a representa- 
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txyc {mop It nrarwT a nufged to be die easiest, or the easiest 
baz mc diat: 5acr 31 xseif s a very good reason why the word 
a ifl iiaxTL raous ozisspcil it because their teachers do not 
realize ±e irrrt iz -nrnmg it. If text-book makers disagree 
5Q vnficiy as :d out die fame words in grades that are three, 
anxr. ant crei ive jear^ ;^art: it is proof of Ae confusion that 
es2Cs 2& :d 'jmsw laari words are^ and when they should be 
TM\^^i Tjere are 7ariiiii& types of words, and each type 
>giim ' Sr uiTcLf s iiL rrscmest. There is the tjrpc that does not 
aced la be r ^mipiL ac aiL Tjere is die type wfakfa ^>pears easy in 
die jcwer rases ami grade aatadered) hard in the upper 
5nr*T 31Z7 jsy^ bem p rrftianir dT tangfat in the lower 
Tjere 2- ±e rjpe nrar spears to possess special difficulty 
5or die -mftifle ^rade^ Tois s dne oq a constant canse — e.g., in 
die case if :Mmose, 11 die Vai 'imi^ at tfie use of the apostrophe 
in pc5!ses;rivesw Tjere are r jges it errors ; there is the problem 
cf -grh vi r>ir r^ y jf jle^voility. sni at ^ jmissHjo . 

Ta :acmi jny acc:ir3te vacant it "* word b^orior ^ we must 
rare 5:r Trcros as iisdnct Lrim imiiyidnals. Moreover we must 
gtv^ zxxr per ctsit - ir n y> dms obcaxned an interpretation for 
difeniitv Tvincii :akfi*5 Arrjmrt jt die distiibuti Dn of spdling 
abilitv. "A'jen -vc ic s? ^e siail imi Jew anre&hDe percentages 
ar^; as imiicann:^ iiitersiices in iid&raifcr. We ^laQ find, for 
instance, drac a iiif'sraice a£ ic aer cent between two words 
ratsd ^ ami ;%^ neans 3ier? -fmn 5jur dmes as great a dtfference 
in 'iiiSaiitT as is drat berveen rw^i wcrds rated at 45 and 55, 
althi.^u^ die percentage iiitersice is in binit cases the same. 
Table XL'*H See arcemiix is a readv reckoner fior die con- 
versicn ct percentage into aiiit> diat take icccont of the form 
of distrtbtrtfcTi. as^^nnnRj it tc be " XoniaL' 

If dtfs ?t3Crr r^iocs 3c mere dian sacw Ac need of word 
criticisni and incfcate a methed. it aiay be wcrtit whHe. Every 
schcwl zf^^ais a piace ami every day a dme at whndt somedtin^ 
may be <i?ne :r? heip dirow ligtit on die aamre of the maferfal 
we deal widi m sretling. .\1 such went :Siettrd be collected and 
made generally avaflable. If teacher?, p iincipa lsw or snpcrnir- 
tendents who have rrrade or who hereafter nmke a sttn^ of die 
difficulty or wcnis. wrll 5i2onnt trrerrr d;: die a u tho r of rhis stndy, 
die data will be gratefttll^r received and milized to 
a larger and more a ccurate knowlec^ie. 
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APPENDIX 

I. List of Authors and Titles Specifically Referred to 

IN the Text 

Thorndike, E. L. Cio). Handwriting. Teachers College Record, Vol. 

XI, No. 2. 
HiLLEGAs, MiLo B. Ci2). A Scalc for the Measurement of Quality in 

English Composition by Young People. Teachers College 

Record, Vol. XIII, No. 4. 
Rice, J. M. ('97). The Futility of the Spelling Grind. Forum, Vol. 

XXIII, pp. 163-172; 409-419. 
Thorndike, E. L. C13). An Introduction to the Theory of Mental and 

Social Measurements. Second Edition. Teachers College, New 

York. 
CoRNMAN, O. P. C02). Spelling in the Elementary School. Ginn and 

Co., New York. 
Walun, J. E. Wallace, (*ii). Spelling Efficiency in Relation to Age, 

Grade, and Sex, and the Question of Transfer. Warwick and 

York, Baltimore. 
Pearson, Henry C. C12). Experimental Studies in the Teaching of 

Spelling. Teachers College Record, Vol. XIII, No. i. 
Spearman, C. ('06). 'Foot-rule' for Measuring Correlation. Brit. 

Joum. of Psych., Vol. II, Pt. I, July, 1906. 
Brown, William, Cii). The Essentials of Mental Measurement. Put- 
nam, New York. 
Whipple, Guy Montrose, Cio). Manual of Mental and Physical Tests. 

Warwick and York, Baltimore. 
Klein, Linus W. ('12). A Study in the Psychology of Spelling. Joum. 

of Ed. Psych., Vol. Ill, No. 7. 
Thorndike, E. L. ('07). The Elimination of Pupils from School. 

Bureau of Education, Bulletin No. 4, 1907. 
Ayres, Leonard P. ('09). Laggards in our Schools. Russell Sage 

Foundation, New York. 
Thorndike, E. L. ('10). Promotion, Retardation, and Elimination. 

Psych. Clinic, Vol. Ill, No. 8 and 9. 
Strayer, George Drayton Cii). Age and Grade Census of Schools and 

Colleges. Bureau of Education, Bulletin No. 5, 191 1. 
Yule, G. Udney ('ii). An Introduction to the Theory of Statistics. 

Lippincott, Philadelphia. 
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11. Lists Referred to in the Text and Used in the Scales 



Preferred List 
First 

1. even 

2. lesson 
3- only 

4. smoke 

5. front 

6. sure 

7. pear 

8. bought 

9. another 

10. forty 

11. pretty 

12. wear 

13. button 

14. minute 

15. cousin 

16. nails 

17. janitor 

18. saucer 

19. stopping 

20. sword 

21. freeze 

22. touch 

23. whistle 

24. carriage 
25 nor 

Second 

26. alread]^ 

27. bef^nning 

28. chicken 

29. choose 

30. circus 

31. grease 

32. pigeons 

33. quarrel 

34. saucy 

35. tailor 

36. telegram 

37. telephone 

38. tobacco 
39- too 

40. towel 

41. Tuesday 

42. tying 

43. whole 

44. against 

45. answer 

46. butcher 

47. p^ess 

48. mstead 

49. raise 

50. beautiful 



Easy 50- Word 
List 

1. you I. 

2. will 2. 

3. hear 3. 

4. him 4. 

5. coming 5. 

6. he 6. 

7. is 7. 

8. on a 
g. the 9. 

10. road 10. 

11. and II. 

12. almost 12. 

13. sure 13. 

14. to 14. 
13. pass 15. 
It. m 16. 
17. front 17. 
la of la 

19. me 19. 

20. I 20. 

21. send 21. 

22. for 22. 

23. every 23. 

24. day 24. 

25. ?o 25. 

26. into 26. 

27. school 27. 

28. but 28. 

29. do 29. 

30. not 30. 

31. touch 31. 

32. table 32. 

33. also 33. 

34. has 34. 
35- only :^5. 

36. one 36. 

37. pair 37. 
3a shoes 38. 

39. they 39. 

40. are 40. 

41. at 41. 

42. all 42. 

43. pretty 43- 

44. no 

45. man 

46. ought 

47. steal 

48. even 

49. a 

so. penny 



Rice Sentence List 



running 

slipped 

listened 

queer 

speech 

believe 

weather 

changeable 

whistling 

frightened 

always 

changing 

chain 

loose 

baking 

piece 

receive 

laughter 

distance 

choose 

strange 

picture 

because 

thought 

purpose 

learn 

lose 

almanac 

neighbor 

writing 

language 

careful 

enough 

necessary 

waiting 

disappoint 

often 

covered 

mixture 

getting 

better 

feather 

light 



44. deceive 

45. driving 

46. surface 

47. rough 

48. smooth 

49. hopping 

50. certainlv 

51. grateful 

52. elegant 

53. present 

54. patience 

55. succeed 

56. severe 

57. accident 

58. sometimes 

59. sensible 

60. business 

61. answer 

62. sweeping 

63. properly 

64. improvement 

65. fati^ing 

66. anxious 

67. appreciate 
6a assure 

69. imagine 

70. peculiar 

71. diaracter 

72. guarantee 

73. approval 

74. intelli^nt 

75. experience 

76. delicious 
yy, realize 

70. importance 

79. occasion 

80. exceptions 

81. thoroughly 

82. conscientious 

83. therefore 

84. ascending 

85. praise 

sis. wholesome 
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III. Memorandum on the Method of Computing with 
Modified Frequency Tables. (Tables XXXVI-XLI.) 

1. Derivation of Median Intervals. Table XLII, lines 4 and 5, gives 
for the 4th grade the number and per cent of pupils who equal or exceed 
the median pupil of each of the other grades. In line 6 the correspond- 
ing P.E. values are shown. These are obtained bjr using Table XXXVII 
as follows: (a) Since 80.9% of 4th-grade pupils surpass the median 
3d-grade pupil, deduct 8090 cases from the high end of the 4th-grade 
distribution. Since there are 5236.32 above i0^«(nor. dis.)* 2853.68 more 
must be taken, extending to a point which is 1.1079 P.E. below Af«(nor. dis.). 
But Af«(nor. dis.) is itself .087 P.E. below Af«(mod. dis.). Correcting for this, 
we have 1.1949 P.E. below 3f«(mod. dis.). ( — 1.1079 — .087 = — 1.1949) 
This is the first entry in line 6 of Table XLII. (b) Deduct 3130 from 
5236.32, leaving 2106.32. By interpellation this corresponds to +.7835 P.E. 
Subtracting .087 P.E. as before, we have +.6965, the second entry in line 
6 of Table XLII. (c) 5236.32 less 11 10 gives 4126.32, correspondincf to 
+ 1.8486 P.E. Again subtracting .087 P.E., we have + 1.7616 P.E., which 
is the third entry in line 6, Table XLII. 

2. Scaling the Words. For "even," Table XLV, columns headed 
" Modified Distributions," the figures are derived as follows, using for 
each grade its proper frequency table: Third Grade. 59% correct. 
Count out the 5900 highest cases. There are 5 141. 7 above Af«(nor. dis.)- 
We must, therefore, take 758.3 cases below that point This brings us 
to — .276 P.E. Subtracting (algebraically) .051 P.E., in order to refer 
this to Mt(mod. dis), We have — .327 P.E., as in Table XLV. Fourth 
Grade. 79% correct. Counting out 7900 cases from the high end, we take 
all the "highs" and 2663.32 of the "lows," reaching as far as — 1.0212 
P.E. But Af«(mod. dis.) is .087 P.E. above AfiCnor. dis.). Subtracting this 
amount, we have — 1.108 P.E. as in Table XLV. Fifth Grade. When 
percentages are high, it is generally easier to count out their complements 
from the low end. " Even " is in this grade 89% correct. We may there- 
fore count 8900 cases from the high end or iioo from the loiv end. In 
either case we reach the 3245th case of the " lows," which corresponds 
to — 1,306 P.E. Correcting for the deflection of the median from its 
"normal" position (.215 P.E.), we have — 1,521 P.E. as given. Sixth 
Grade. 369(5 — 700^2996. The 2996th case corresponds to — 1.339 P-E. 
Median displacement = 418 P.E. Subtracting from —1.339 P-E., we 
have — 1.757 P.E., as given. The 7th and 8th grade positions are derived 
in the same way, care being taken to use the proper grade table of fre- 
quency in each case. 

Table XLVI. The average position for each word as given in the 
column headed " Modified Distributions " was computed as follows : Add 
to the P.E. value of " even " for each grade (Table XLV) the distance 
which the grade median is above the 3rd-grade median. From Table 
XLII these distances are shown to be: M8-4, 1.148 P. E. ; Mi-%, 1.882 P.E. ; 
Mt-%, 2.726 P.E. ; Afa-T, 3.262 P.R; Af»-«. 3.948 P.E. Adding these values 
to those of Table XLV, beginning with the 4th grade and writing the 
3rd grade as given, we have the following P.E. values: — .327, +.040, 
-f .361, +.969, + 1.541, and + 1.932. The average of these is +753 P.E., 
as given for the word " even " in Table XLVI. The average positions of 
the remaining words were computed in the same way. 
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IV. TABLE XLVII — ^P.E. Values Corresponding to Given Per Cents 
OP THE Normal Surface op Frequency, Per Cents Being Taken 
FROM THE Median 
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.512 


.516 
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.559 
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.567 


15 


.571 


.575 
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.588 
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.596 


.600 
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.608 


16 


.612 


.616 


.620 
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.632 


.636 
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.644 


.648 


17 


.652 


.656 


.660 


.665 
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.673 


.677 


.681 


.685 


.689 


18 


.693 


.698 


.702 


.706 


.710 


.714 


.719 


.723 


.727 


.731 


19 


.735 


.740 


.744 


.748 


.752 


.756 


.761 


.765 


.769 


.773 


20 


.778 


.782 


.786 


.790 


.795 


.799 


.803 


.807 


.812 


.816 


21 


.820 


.825 


.829 


.834 


.838 


.842 
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.851 


.855 


.860 


22 


.864 


.869 


.873 


.878 


.882 


.886 
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.895 


.900 


.904 


23 


.909 


.913 


.918 


.922 


.927 


.931 


.936 


.940 


.945 


.949 


24 


.954 


.958 


.963 


.968 


.972 


.977 


.982 


.986 


.991 


.996 


25 


1.000 


1.005 1.009 


1.014 


1.019 


1.024 1.028 


1.033 


1.038 


1.042 



26 1.047 1.052 1.057 1.062 1.067 1.071 1.076 1.081 1.086 1.091 

27 1.096 1.101 1.105 1.110 1.115 1.120 1.125 1.130 1.135 1.140 

28 1.145 1.150 1.155 1.160 1.165 1.170 1.176 1.181 1.186 1.191 

29 1.196 1.201 1.206 1.211 1.217 1.222 1.227 1.232 1.238 1.243 

30 1.248 1.253 1.259 1.264 1.269 1.275 1.279 1.286 1.291 1.296 

31 1.302 1.307 1.313 1.318 1.324 1.329 1.335 1.340 1.346 1.351 

32 1.357 1.363 1.368 1.374 1.380 1.386 1.391 1.397 1.403 1.409 

33 1.415 1.421 1.427 1.432 1.438 1.444 1.450 1.456 1.462 1.469 

34 1.475 1.481 1.487 1.493 1.499 1.506 1.512 1.518 1.524 1.531 

35 1.537 1.543 1.549 1.556 1.563 1.569 1.576 1.582 1.589 1.595 

36 1.602 1.609 1.616 1.622 1.629 1.636 1.643 1.649 1.656 1.663 

37 1.670 1.677 1.685 1.692 1.699 1.706 1.713 1.720 1.728 1.735 

38 1.742 1.749 1.757 1.765 1.772 1.780 1.788 1.795 1.803 1.811 

39 1.819 1.827 1.835 1.843 1.851 1.859 1.867 1.875 1.884 1.892 

40 1.900 1.909 1.918 1.926 1.935 1.944 1.953 1.962 1.971 1.979 

41 1.988 1.997 2.007 2.016 2.026 2.035 2.044 2.054 2.064 2.074 

42 2.083 2.093 2.103 2.114 2.124 2.134 2.145 2.155 2.166 2.177 

43 2.188 2.199 2.211 2.222 2.234 2.245 2.257 2.269 2.281 2.293 

44 2.305 2.318 2.331 2.344 2.357 2.370 2.384 2.397 2.411 2.426 
46 2.439 2.453 2.468 2.483 2.498 2.514 2.530 2.546 2.562 2.579 

46 2.597 2.614 2.631 2.648 2.667 2.686 2.706 2.726 2.746 2.767 

47 2.789 2.811 2.834 2.857 2.881 2.905 2.932 2.958 2.986 3.016 

48 3.044 3.077 3.111 3.146 3.182 3.219 3.258 3.300 3.346 3.396 

49 3.450 3.506 3.571 3.643 3.725 3.820 3.938 4.083 4.276 4.600 
60 
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